-- Logs begin at Tue 2022-08-09 17:36:36 UTC, end at Tue 2022-08-09 19:11:42 UTC. -- Aug 09 18:40:06.152971 dv-cinder-826608-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 09 18:40:06.162580 dv-cinder-826608-9-iscsi devstack@n-api.service[110212]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 09 18:40:06.164522 dv-cinder-826608-9-iscsi devstack@n-api.service[110212]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 9 18:40:06 2022] *** Aug 09 18:40:06.164522 dv-cinder-826608-9-iscsi devstack@n-api.service[110212]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 09 18:40:06.164522 dv-cinder-826608-9-iscsi devstack@n-api.service[110212]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 09 18:40:06.164522 dv-cinder-826608-9-iscsi devstack@n-api.service[110212]: nodename: dv-cinder-826608-9-iscsi Aug 09 18:40:06.164522 dv-cinder-826608-9-iscsi devstack@n-api.service[110212]: machine: x86_64 Aug 09 18:40:06.164522 dv-cinder-826608-9-iscsi devstack@n-api.service[110212]: clock source: unix Aug 09 18:40:06.164522 dv-cinder-826608-9-iscsi devstack@n-api.service[110212]: pcre jit disabled Aug 09 18:40:06.164522 dv-cinder-826608-9-iscsi devstack@n-api.service[110212]: detected number of CPU cores: 4 Aug 09 18:40:06.164522 dv-cinder-826608-9-iscsi devstack@n-api.service[110212]: current working directory: / Aug 09 18:40:06.164522 dv-cinder-826608-9-iscsi devstack@n-api.service[110212]: detected binary path: /usr/bin/uwsgi-core Aug 09 18:40:06.165201 dv-cinder-826608-9-iscsi devstack@n-api.service[110212]: your processes number limit is 47680 Aug 09 18:40:06.165201 dv-cinder-826608-9-iscsi devstack@n-api.service[110212]: your memory page size is 4096 bytes Aug 09 18:40:06.165201 dv-cinder-826608-9-iscsi devstack@n-api.service[110212]: detected max file descriptor number: 2048 Aug 09 18:40:06.165201 dv-cinder-826608-9-iscsi devstack@n-api.service[110212]: lock engine: pthread robust mutexes Aug 09 18:40:06.165201 dv-cinder-826608-9-iscsi devstack@n-api.service[110212]: thunder lock: enabled Aug 09 18:40:06.165201 dv-cinder-826608-9-iscsi devstack@n-api.service[110212]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 09 18:40:06.165201 dv-cinder-826608-9-iscsi devstack@n-api.service[110212]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 09 18:40:06.204751 dv-cinder-826608-9-iscsi devstack@n-api.service[110212]: Python main interpreter initialized at 0x5619cf7269c0 Aug 09 18:40:06.204751 dv-cinder-826608-9-iscsi devstack@n-api.service[110212]: python threads support enabled Aug 09 18:40:06.204751 dv-cinder-826608-9-iscsi devstack@n-api.service[110212]: your server socket listen backlog is limited to 100 connections Aug 09 18:40:06.204751 dv-cinder-826608-9-iscsi devstack@n-api.service[110212]: your mercy for graceful operations on workers is 90 seconds Aug 09 18:40:06.205108 dv-cinder-826608-9-iscsi devstack@n-api.service[110212]: mapped 403077 bytes (393 KB) for 2 cores Aug 09 18:40:06.205108 dv-cinder-826608-9-iscsi devstack@n-api.service[110212]: *** Operational MODE: preforking *** Aug 09 18:40:06.205255 dv-cinder-826608-9-iscsi devstack@n-api.service[110212]: *** uWSGI is running in multiple interpreter mode *** Aug 09 18:40:06.205255 dv-cinder-826608-9-iscsi devstack@n-api.service[110212]: spawned uWSGI master process (pid: 110212) Aug 09 18:40:06.205453 dv-cinder-826608-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 09 18:40:06.206279 dv-cinder-826608-9-iscsi devstack@n-api.service[110212]: spawned uWSGI worker 1 (pid: 110213, cores: 1) Aug 09 18:40:06.206392 dv-cinder-826608-9-iscsi devstack@n-api.service[110212]: spawned uWSGI worker 2 (pid: 110214, cores: 1) Aug 09 18:40:06.206461 dv-cinder-826608-9-iscsi devstack@n-api.service[110212]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 09 18:40:06.870412 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 18:40:06.878150 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 18:40:07.949221 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 18:40:07.949221 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: from cryptography.utils import int_from_bytes Aug 09 18:40:07.949848 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 18:40:07.949848 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: from cryptography.utils import int_from_bytes Aug 09 18:40:07.960224 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 18:40:07.960224 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: from cryptography.utils import int_from_bytes Aug 09 18:40:07.960713 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 18:40:07.960713 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: from cryptography.utils import int_from_bytes Aug 09 18:40:10.443879 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 18:40:10.444466 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 18:40:10.444978 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 18:40:10.446081 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 18:40:10.446444 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 18:40:10.446856 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.447215 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.447560 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.448017 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.448515 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.448986 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.449458 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.449900 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.450339 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.450754 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.451103 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.451661 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826608-9-iscsi {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.452212 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.452843 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.453384 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.453945 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.454095 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 18:40:10.454494 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 18:40:10.454573 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.454891 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 18:40:10.455119 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.455332 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 18:40:10.455518 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 18:40:10.455615 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.455908 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.456237 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.456469 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.456585 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.456968 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.457147 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.457307 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.459712 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.459820 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.459953 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.459953 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.460144 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.460271 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.460271 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.460436 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.460570 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.460570 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826608-9-iscsi {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.460774 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.460857 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.460978 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.461692 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.461692 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.461905 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.461988 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.462087 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.462169 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.462169 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.462373 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.462502 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.462636 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.462796 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.463027 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826608-9-iscsi {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.463121 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.463374 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.463584 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.463693 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.464004 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.464090 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.464345 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.464488 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.464653 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.464977 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.465070 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.465289 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.465510 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.465641 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.465943 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.466029 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.466344 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826608-9-iscsi {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.466447 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.466666 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.466874 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.466988 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.467307 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.467395 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.467723 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.467816 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.468037 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.468285 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.468379 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.468658 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.468773 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.468984 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.469225 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.469326 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.469640 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.469748 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.470083 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.470176 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.470578 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.470742 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.471052 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.471311 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.471464 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.471778 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.471877 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.472035 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.472343 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.472451 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.472667 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.472909 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.472997 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.473305 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.473392 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.473575 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.473664 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.473831 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.473984 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.474148 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.474444 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.474529 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.474773 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.475007 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.475105 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.475375 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.475578 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.475704 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.475923 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.476020 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.476264 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.476351 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.476557 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.476662 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.476828 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.476929 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.477247 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.477579 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.477724 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.477902 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.478066 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.478207 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.478390 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.478523 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.478710 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.478920 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.479015 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.479243 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.479346 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.479545 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.479632 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.479880 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.479975 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.480196 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.480282 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.480500 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.480585 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.480816 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.480912 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.481135 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.481222 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.481439 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.481540 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.481765 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.481854 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.482064 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.482162 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.482370 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.482514 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.482703 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.482847 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.483002 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.483098 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.483251 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.483406 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.483550 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.483732 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.483853 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.484048 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.484166 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.484374 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.484471 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.484761 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.484851 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.485061 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.485154 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.485358 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.485457 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.485682 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.485797 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.485984 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.486127 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.486397 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.486486 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.486699 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.486786 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.487000 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.487087 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.487305 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.487413 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.487603 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.487689 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.487924 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.488017 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.488237 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.488324 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.488550 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.488636 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.488861 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.488957 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.489171 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.489325 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.489469 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.489649 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.489870 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.489997 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.490090 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.490246 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.490403 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.490562 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.490715 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.490865 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.491026 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.491228 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.491337 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.491545 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.491632 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.491848 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.491938 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.492674 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.492789 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.492989 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.493116 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.493292 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.493431 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.493615 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.493770 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.493929 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.494081 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.494225 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.494394 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.494531 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.494718 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.494843 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.495032 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.495133 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.495342 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.495428 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.495674 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.495828 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.495979 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.496082 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.496281 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.496378 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.496580 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.496666 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.496879 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.496975 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.497179 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.497266 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.497472 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.497593 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.497809 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.497897 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.498126 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.498245 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.498511 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.498607 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.498837 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.499080 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.499166 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.499439 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.499625 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.499808 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.500135 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.500232 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.500475 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.500673 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.500784 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.501116 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.501227 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.501452 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.501761 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.501858 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.502086 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.502192 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.502399 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.502496 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.502713 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.502806 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.503018 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.503142 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.503334 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.503666 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.503794 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.503953 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.504268 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.504365 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.504597 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.504682 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.504910 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.504998 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.505223 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.505322 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:40:10.505552 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.505700 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.505865 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.506241 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.506582 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.506690 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.506886 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.506981 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.507191 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.507292 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.507528 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.507637 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.508476 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.508608 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.508811 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.508943 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.509135 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.509268 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.509463 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.509622 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.509827 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.509933 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.510149 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.510238 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.510471 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.510554 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.510793 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.510881 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.511128 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.511296 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.511444 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.511593 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.511753 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.511840 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.512061 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.512150 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.512367 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.512453 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.512674 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.512769 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.512982 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.513069 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.513287 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.513382 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.513649 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.513756 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.513961 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.514066 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.514269 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.514356 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.514582 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.514683 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.514899 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.515099 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.515222 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.515345 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.515498 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.515594 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.515803 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.515887 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.516102 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.516190 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.516402 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.516491 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.516701 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.516797 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.517005 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.517092 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.517303 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.517441 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.517707 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.517797 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.518031 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.518118 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.518331 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.518420 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.518658 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.518745 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.518960 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.519054 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.519265 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.519354 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.519569 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.519655 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.519922 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.520027 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.520176 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.520271 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.520481 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.520575 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.520784 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.520880 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.521084 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.521178 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.521401 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.521495 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.521731 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.521839 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.522033 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.522121 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.522350 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.522548 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.522639 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.522936 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.523088 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.523244 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.523576 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.523673 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.523884 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.524162 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.524289 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.524490 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.524733 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.524828 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.525103 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.525191 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.525410 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.525496 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.525764 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.525851 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.526089 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.526255 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.526389 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.526707 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.526824 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.527072 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.527339 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.527428 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.527643 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.527744 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.527951 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.528069 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.528253 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.528466 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.528554 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.528799 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.528885 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.529135 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.529288 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.529434 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.529758 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.529883 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.530060 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.530359 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.530447 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.530657 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.530860 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.530995 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.531191 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.531288 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.531536 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.531632 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.531835 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.531922 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.532135 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.532231 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.532472 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.532559 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.532770 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.532856 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.533100 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.533194 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.533422 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.533509 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.533755 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.533854 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.534080 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.534168 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.534388 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.534477 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.534698 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.534791 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.535004 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.535099 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.535311 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.535398 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.535617 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.535712 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.535923 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.536011 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.536239 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.536325 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.536545 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.536640 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.536860 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.536954 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.537164 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.537251 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.537479 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.537606 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.537808 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.537893 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.538116 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.538201 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.538413 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.538510 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.538724 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.538818 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.539059 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.539150 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.539371 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.539472 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.539778 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.539865 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.540211 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.540296 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.540737 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.540825 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.541257 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.541342 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.541744 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.541834 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.542078 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.542206 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.542387 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.542669 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.542763 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.542997 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.543193 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.543304 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.543617 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.543702 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.543966 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.544192 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.544319 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.544581 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.544690 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.544893 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.545195 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.545298 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.545504 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.545763 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.545848 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.546143 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.546231 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.546455 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.546626 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.546760 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.547075 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.547377 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.547681 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.547992 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.548292 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.548594 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.548897 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.549203 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.549508 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.549833 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.550101 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.550189 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.550434 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.550598 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.550718 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.551023 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.551161 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.551316 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.551577 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.551666 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.551923 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.552050 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.552227 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.552564 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.552782 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.552878 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.552957 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.553270 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.553357 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.553642 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.553808 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.553975 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.554137 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.555079 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.555247 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.555415 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.555693 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.555781 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.556002 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.556093 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.556305 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.556421 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.556649 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.556753 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.556960 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.557069 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.557263 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.557388 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.557604 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.557740 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.557926 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.558060 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.558349 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.558436 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.558666 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.558767 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.558973 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.559060 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.559279 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.559374 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.559595 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.559692 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.559902 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.559997 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.560206 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.560302 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.560533 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.560620 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.560850 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.560936 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.561173 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.561260 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.561479 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.561588 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.561818 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.561906 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.562123 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.562211 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.562429 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.562517 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.562732 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.562818 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.563030 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.563118 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.563334 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.563422 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.563647 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.563781 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.564102 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.564225 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.564423 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.564556 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.564736 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.564865 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.565052 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.565179 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.565370 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.565489 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.565718 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.565827 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.566035 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.566155 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.566351 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.566476 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.566664 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.566823 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.566984 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.567126 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.567299 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.567430 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.567610 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.567730 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.567918 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.568030 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.568235 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.568323 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.568562 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.568760 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.569011 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.569106 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.569347 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.569631 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.569722 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.569966 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.570228 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.570841 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.571129 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.571313 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.571433 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.571744 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.571829 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.572045 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.572353 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.572439 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.572654 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.572792 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.572971 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.573126 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.573274 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.573450 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.573594 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.573895 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.574029 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.574194 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.574536 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.574654 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.574837 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.575163 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.575260 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.575483 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.575578 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.575817 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.575901 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.576117 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.576213 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.576419 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.576512 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.576738 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.577039 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.577332 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.577431 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.577652 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.577743 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.577960 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.578058 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.578323 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.578410 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.578650 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.578968 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.579053 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.579290 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.579385 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.579602 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.579695 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.579915 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.580001 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.580226 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.580399 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.580531 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.580620 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.580837 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.580932 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.581138 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.581234 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.581451 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.581597 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.581789 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.581877 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.582106 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.582202 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.582429 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.582515 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.582735 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.583042 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.583138 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.583345 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.583432 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.583653 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.583748 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.583957 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.584052 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.584276 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.584370 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.584577 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.584666 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.584879 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.584976 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.585178 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.585304 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.585623 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.585713 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.585960 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.586062 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.586264 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.586359 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.586584 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.586670 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.586890 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.586985 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.587191 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.587279 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.587489 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.587576 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.587799 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.587892 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.588110 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.588206 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.588426 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.588512 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.588730 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.588824 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.589035 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.589121 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.589342 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.589432 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.589666 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.589772 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.589972 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.590059 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.590273 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.590360 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.590573 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.590668 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.590871 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.590975 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.591172 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.591259 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.591468 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.591557 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.591765 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.591853 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.592062 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.592147 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.592362 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.592457 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.592663 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.592749 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.592981 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.593069 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.593287 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.593376 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.593612 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.593703 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.593914 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.594012 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.594212 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.594300 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.594556 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.594642 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.594856 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.594954 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.595187 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.595332 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.595624 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.595709 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.595932 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.596185 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.596280 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.596536 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.596744 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.596829 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.597132 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.597308 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.597430 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.597761 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.597849 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.598066 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.598370 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.598467 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.598669 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.598757 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.598966 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.599087 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.599280 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.599472 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.599587 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.599892 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.600042 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.600207 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.600521 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.600608 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.600838 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.601005 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.601140 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.601339 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.601445 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.601716 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.601801 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.602036 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.602122 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.602446 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.602753 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.602841 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.603059 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.603172 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.603373 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.603503 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.603806 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.603907 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.604135 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.604440 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.604592 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.604850 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.605088 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.605295 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.605749 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.605844 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.605914 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.605988 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.606055 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.606055 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.606173 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.606364 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.606450 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.606672 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.606763 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.606978 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.607066 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.607287 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.607385 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.607598 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.607693 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.607906 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.608000 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.608210 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.608378 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.608586 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.608672 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.608899 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.608987 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.609218 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.609335 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.609567 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.609658 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.609894 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.609984 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.610205 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.610305 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.610523 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.610658 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.610834 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.610968 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.611147 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.611271 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.611457 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.611769 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.611853 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.612076 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.612169 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.612380 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.612464 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.612685 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.612777 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.612993 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.613090 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.613303 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.613389 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.613658 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.613749 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.613976 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.614075 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.614275 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.614370 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.614575 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.614662 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.614879 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.614967 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.615195 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.615281 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.615494 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.615580 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.615811 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.615894 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.616165 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.616250 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.616486 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.616572 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.616793 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.616880 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.617664 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.617773 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.617988 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.618076 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.618306 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.618395 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.618617 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.618703 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.618935 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.619021 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.619249 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.619337 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.619550 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.619635 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.619858 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.619950 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.620162 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.620256 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.620483 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.620567 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.620798 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.620920 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.621112 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.621228 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.621551 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.621724 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.621856 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.622173 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.622296 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.622488 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.622796 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.622889 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.623109 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.623372 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.623574 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.623828 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.623981 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.624132 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.624411 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.624502 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.624730 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.624816 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.625029 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.625123 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.625334 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.625541 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.625670 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.625973 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.626129 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.626274 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.626589 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.626683 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.626890 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.626986 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.627232 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.627337 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.627494 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.627583 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.627797 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.627891 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.628095 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.628392 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.628707 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.628799 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.629005 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.629093 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.629320 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.629415 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.629691 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.629793 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.630018 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.630113 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.630332 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.630427 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.630632 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.630719 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.630948 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.631044 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.631248 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.631334 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.631547 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.631643 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.631846 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.631992 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.632143 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.632315 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.632480 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.632635 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.632826 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.633515 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.633682 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.633858 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.634010 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.634177 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.634334 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.634593 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.634679 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.634920 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.635016 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.635235 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.635332 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.635565 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.635660 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.635877 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.635974 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.636194 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.636289 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.636492 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.636580 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.636868 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.636962 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.637178 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.637265 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.637485 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.637628 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.637810 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.637900 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.638110 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.638198 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.638414 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.638501 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.638712 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.638801 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.639039 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.639125 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.639351 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.639437 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.639675 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.639770 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.639974 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.640093 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.640289 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.640411 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.640594 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.640722 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.640893 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.641140 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.641234 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.641460 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.641567 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.641806 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.641901 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.642111 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.642198 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.642436 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.642530 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.642743 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.642830 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.643057 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.643142 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.643367 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.643462 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.643679 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.643776 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.643992 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.644081 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.644298 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.644386 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.644605 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.644692 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.644914 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.645014 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.645220 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.645307 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.645575 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.645666 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.645851 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.645956 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.646160 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.646247 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.646496 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.646590 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.647142 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.647237 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.647464 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.647719 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.647806 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.648066 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.648285 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.648399 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.648693 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.648865 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.648983 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.649299 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.649465 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.649641 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.649917 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.650005 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.650226 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.650327 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.650549 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.650639 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.650866 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.651099 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.651186 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.651502 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.651678 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.651817 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.652129 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.652217 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.652440 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.652535 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.652752 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.652839 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.653104 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.653194 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.653414 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.653738 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.653978 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.654065 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.654313 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.654409 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.654635 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.654723 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.654972 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.655067 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.655291 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.655379 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.655602 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.655690 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.655913 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.656000 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.656220 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.656306 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.656528 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.656617 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.656837 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.656924 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.657146 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.657240 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.657465 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.657568 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.657812 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.657896 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.658125 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.658223 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.658435 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.658528 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.658743 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.658836 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.659053 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.659220 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.659490 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.659577 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.659832 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.659918 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.660169 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.660296 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.660489 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.660618 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.660830 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.660925 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.661163 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.661259 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.661487 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.661665 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.661838 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.661988 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.662169 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.662288 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.662481 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.662676 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.662791 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.662983 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.663107 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.663288 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.663418 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.663655 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.663743 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.663991 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.664090 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.664297 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.664385 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.664650 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.664736 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.664959 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.665056 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.665260 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.665353 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.665605 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.665822 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.665924 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.666169 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.666257 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.666481 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.666565 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.666802 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.666962 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.667120 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.667207 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.667427 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.667524 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.667728 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.667826 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.668050 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.668191 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.668337 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.668451 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.668638 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.668728 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.668952 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.669052 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.669253 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.669342 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.669572 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.669668 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.669881 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.670035 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.670183 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.670324 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.670477 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.670566 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.670776 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.670863 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.671164 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.671250 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.671490 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.671645 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.671809 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.672096 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.672229 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.672397 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.672698 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.672792 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.673005 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.673276 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.673377 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.673612 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.673915 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.674215 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.674299 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.674523 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.674696 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.674821 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.675034 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.675129 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.675383 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.675471 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.675708 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.675962 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.676051 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.676296 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.676554 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.676637 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.676898 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.676990 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.677195 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.677283 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.677566 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.677658 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.677885 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.677974 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.678249 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.678569 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.678794 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.678890 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.679144 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.679497 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.680272 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.680374 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.680655 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.680742 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.681008 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.681201 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.681343 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.681553 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.681728 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.681879 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.682065 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.682215 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.682395 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.682544 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.682765 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.682917 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.683093 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.683181 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.683409 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.683495 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.683733 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.683829 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.684039 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.684127 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.684346 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.684443 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.684652 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.684741 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.684975 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.685065 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.685264 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.685351 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.685605 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.685712 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.685921 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.686008 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.686228 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.686330 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.686536 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.686626 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.686842 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.686929 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.687145 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.687245 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.687451 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.687581 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.687757 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.687910 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.688061 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.688232 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.688371 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.688551 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.688707 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.688872 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.689024 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.689412 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.689507 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.689761 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.689849 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.690081 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.690179 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.690389 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.690478 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.690696 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.690783 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.691002 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.691102 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.691307 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.691395 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.691661 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.691747 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.691972 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.692076 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.692281 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.692369 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.692588 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.692669 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.692898 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.693006 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.693206 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.693301 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.693578 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.693670 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.693874 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.693964 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.694182 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.694269 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.694510 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.694605 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.694823 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.694912 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.695134 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.695893 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.695991 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.696258 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.696347 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.696583 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.696678 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.696916 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.697004 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.697238 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.697332 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.697579 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.697668 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.697883 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.697972 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.698187 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.698284 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.698488 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.698577 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.698792 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.698881 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.699107 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.699198 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.699412 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.699507 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.699717 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.699824 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.700017 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.700137 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.700444 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.700531 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.700744 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.701015 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.701104 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.701332 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.701581 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.701672 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.701951 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.702148 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.702245 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.702537 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.702650 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.702836 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.703135 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.703236 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.703436 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.703646 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.703757 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.703949 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.704047 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.704269 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.704509 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.704822 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.704911 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.705125 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.705379 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.705469 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.705743 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.705934 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.706082 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.706263 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.706415 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.706584 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.706729 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.706912 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.707049 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.707231 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.707357 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.707676 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.707983 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.708076 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.708385 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.708494 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.708706 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.708792 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.709017 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.709101 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.709336 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.709436 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.709684 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.709795 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.710020 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.710117 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.710331 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.710430 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.710641 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.710737 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.710993 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.711094 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.711297 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.711399 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.711607 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.711695 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.711931 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.712018 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.712255 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.712344 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.712559 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.712642 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.712884 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.712968 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.713199 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.713463 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.713566 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.713835 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.713924 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.714139 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.714235 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.714466 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.714583 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.714772 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.714929 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.715079 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.715248 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.715383 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.715560 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.715722 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.715872 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.716135 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.716225 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.716451 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.716571 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.716759 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.716847 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.717109 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.717196 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.717426 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.717514 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.717770 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.717949 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.718089 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.718173 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.718534 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.718783 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.718977 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.719193 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.719308 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.719556 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.719794 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.719995 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.720173 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.720315 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.720583 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.720809 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.720952 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.721286 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.721570 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.721817 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.722003 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.722150 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.722234 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.722323 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.722419 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.722501 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.722636 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.722715 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 18:40:10.722783 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.722783 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.722783 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.723013 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.723241 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.723553 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.723873 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.724206 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.724524 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.724838 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.725264 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.725604 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.725930 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.726255 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.726629 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.727155 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.727743 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.728305 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.728889 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.729397 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.730015 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.730384 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.730734 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.731077 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.731398 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.731718 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.732208 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.732779 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.733361 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.733727 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.734050 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.734367 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.734697 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.735550 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.735875 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.736189 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.736507 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.736826 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.737140 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.737453 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.737796 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.738111 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.738421 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.738733 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.739050 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.739361 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.739674 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.739984 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.740294 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.740602 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.740943 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.741377 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.741727 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.742062 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.742909 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.743239 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.743556 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.743884 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.744210 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.744534 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.744849 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.745189 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.745511 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.745852 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.746169 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.746487 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.746809 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.747120 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.747452 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.747784 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.748096 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.748426 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.748747 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.749073 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.749395 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.749736 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.750072 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.750386 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.750701 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.751015 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.751329 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.751644 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.751961 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.752272 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.752586 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.752905 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.753224 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.753692 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.754285 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.754845 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.755438 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.755966 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.756601 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.756983 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.757350 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.757750 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.758614 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.759052 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.759608 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:40:10.760059 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 18:40:10.878949 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO dbcounter [None req-d6c3db6d-67cf-42a9-9243-6d61532779d2 None None] Registered counter for database nova_api Aug 09 18:40:10.901677 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG oslo_db.sqlalchemy.engines [None req-d6c3db6d-67cf-42a9-9243-6d61532779d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110214) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 18:40:10.909437 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG dbcounter [-] [110214] Writer thread running {{(pid=110214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 18:40:10.935554 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: INFO dbcounter [None req-9ccfee98-6d68-41e8-ba41-c53188c0ff42 None None] Registered counter for database nova_api Aug 09 18:40:10.955102 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG oslo_db.sqlalchemy.engines [None req-9ccfee98-6d68-41e8-ba41-c53188c0ff42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110213) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 18:40:10.967230 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.context [None req-d6c3db6d-67cf-42a9-9243-6d61532779d2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9980bb26-9539-4867-bcdf-a8100feea5e1(cell1) {{(pid=110214) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 18:40:10.971093 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG oslo_concurrency.lockutils [None req-d6c3db6d-67cf-42a9-9243-6d61532779d2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:40:10.971563 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG oslo_concurrency.lockutils [None req-d6c3db6d-67cf-42a9-9243-6d61532779d2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:40:10.973081 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG oslo_concurrency.lockutils [None req-d6c3db6d-67cf-42a9-9243-6d61532779d2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:40:10.973820 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG oslo_concurrency.lockutils [None req-d6c3db6d-67cf-42a9-9243-6d61532779d2 None None] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:40:10.974263 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG oslo_concurrency.lockutils [None req-d6c3db6d-67cf-42a9-9243-6d61532779d2 None None] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:40:10.976210 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG oslo_concurrency.lockutils [None req-d6c3db6d-67cf-42a9-9243-6d61532779d2 None None] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:40:10.977131 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG dbcounter [-] [110213] Writer thread running {{(pid=110213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 18:40:10.978843 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO dbcounter [None req-d6c3db6d-67cf-42a9-9243-6d61532779d2 None None] Registered counter for database nova_cell0 Aug 09 18:40:10.984802 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO dbcounter [None req-d6c3db6d-67cf-42a9-9243-6d61532779d2 None None] Registered counter for database nova_cell1 Aug 09 18:40:10.993304 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG oslo_db.sqlalchemy.engines [None req-d6c3db6d-67cf-42a9-9243-6d61532779d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110214) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 18:40:10.994539 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG oslo_db.sqlalchemy.engines [None req-d6c3db6d-67cf-42a9-9243-6d61532779d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110214) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 18:40:11.001099 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG dbcounter [-] [110214] Writer thread running {{(pid=110214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 18:40:11.002585 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG dbcounter [-] [110214] Writer thread running {{(pid=110214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 18:40:11.043679 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.context [None req-9ccfee98-6d68-41e8-ba41-c53188c0ff42 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9980bb26-9539-4867-bcdf-a8100feea5e1(cell1) {{(pid=110213) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 18:40:11.047569 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG oslo_concurrency.lockutils [None req-9ccfee98-6d68-41e8-ba41-c53188c0ff42 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:40:11.048042 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG oslo_concurrency.lockutils [None req-9ccfee98-6d68-41e8-ba41-c53188c0ff42 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:40:11.049617 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG oslo_concurrency.lockutils [None req-9ccfee98-6d68-41e8-ba41-c53188c0ff42 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:40:11.050339 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG oslo_concurrency.lockutils [None req-9ccfee98-6d68-41e8-ba41-c53188c0ff42 None None] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:40:11.050782 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG oslo_concurrency.lockutils [None req-9ccfee98-6d68-41e8-ba41-c53188c0ff42 None None] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:40:11.052762 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG oslo_concurrency.lockutils [None req-9ccfee98-6d68-41e8-ba41-c53188c0ff42 None None] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:40:11.055714 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: INFO dbcounter [None req-9ccfee98-6d68-41e8-ba41-c53188c0ff42 None None] Registered counter for database nova_cell0 Aug 09 18:40:11.061300 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: INFO dbcounter [None req-9ccfee98-6d68-41e8-ba41-c53188c0ff42 None None] Registered counter for database nova_cell1 Aug 09 18:40:11.068704 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG oslo_db.sqlalchemy.engines [None req-9ccfee98-6d68-41e8-ba41-c53188c0ff42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110213) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 18:40:11.071375 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG oslo_db.sqlalchemy.engines [None req-9ccfee98-6d68-41e8-ba41-c53188c0ff42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110213) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 18:40:11.075207 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG dbcounter [-] [110213] Writer thread running {{(pid=110213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 18:40:11.148421 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO dbcounter [None req-d6c3db6d-67cf-42a9-9243-6d61532779d2 None None] Registered counter for database nova_cell0 Aug 09 18:40:11.160059 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG oslo_db.sqlalchemy.engines [None req-d6c3db6d-67cf-42a9-9243-6d61532779d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110214) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 18:40:11.165571 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG dbcounter [-] [110214] Writer thread running {{(pid=110214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 18:40:11.216169 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG dbcounter [-] [110213] Writer thread running {{(pid=110213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 18:40:11.226045 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: INFO dbcounter [None req-9ccfee98-6d68-41e8-ba41-c53188c0ff42 None None] Registered counter for database nova_cell0 Aug 09 18:40:11.233558 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG oslo_db.sqlalchemy.engines [None req-9ccfee98-6d68-41e8-ba41-c53188c0ff42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110213) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 18:40:11.237963 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG dbcounter [-] [110213] Writer thread running {{(pid=110213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 18:40:11.588221 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: WARNING keystonemiddleware.auth_token [None req-d6c3db6d-67cf-42a9-9243-6d61532779d2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 18:40:11.595456 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: WARNING keystonemiddleware.auth_token [None req-d6c3db6d-67cf-42a9-9243-6d61532779d2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 18:40:11.636816 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: WARNING keystonemiddleware.auth_token [None req-9ccfee98-6d68-41e8-ba41-c53188c0ff42 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 18:40:11.644039 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: WARNING keystonemiddleware.auth_token [None req-9ccfee98-6d68-41e8-ba41-c53188c0ff42 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 18:40:11.943240 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: WARNING keystonemiddleware.auth_token [None req-d6c3db6d-67cf-42a9-9243-6d61532779d2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 18:40:11.949661 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: WARNING keystonemiddleware.auth_token [None req-d6c3db6d-67cf-42a9-9243-6d61532779d2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 18:40:11.954882 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5619cf7269c0 pid: 110214 (default app) Aug 09 18:40:11.956951 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi [None req-d6c3db6d-67cf-42a9-9243-6d61532779d2 None None] Calling method '>' {{(pid=110214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:40:11.958158 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO nova.api.openstack.requestlog [None req-d6c3db6d-67cf-42a9-9243-6d61532779d2 None None] 10.222.0.57 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001763 Aug 09 18:40:11.958560 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: [pid: 110214|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 788 bytes} [Tue Aug 9 18:40:11 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:40:11.982571 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: WARNING keystonemiddleware.auth_token [None req-9ccfee98-6d68-41e8-ba41-c53188c0ff42 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 18:40:11.989277 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: WARNING keystonemiddleware.auth_token [None req-9ccfee98-6d68-41e8-ba41-c53188c0ff42 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 18:40:11.995101 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5619cf7269c0 pid: 110213 (default app) Aug 09 18:41:32.007781 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi [None req-d6c3db6d-67cf-42a9-9243-6d61532779d2 None None] Calling method '>' {{(pid=110214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:32.008688 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO nova.api.openstack.requestlog [None req-d6c3db6d-67cf-42a9-9243-6d61532779d2 None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Aug 09 18:41:32.009621 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: [pid: 110214|app: 0|req: 2/2] 10.222.0.57 () {54 vars in 931 bytes} [Tue Aug 9 18:41:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:41:32.021376 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG dbcounter [-] [110213] Writing DB stats nova_api:SELECT=3 {{(pid=110213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:41:32.022747 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG dbcounter [-] [110213] Writing DB stats nova_cell0:SELECT=3 {{(pid=110213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:41:32.023634 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG dbcounter [-] [110213] Writing DB stats nova_cell1:SELECT=3 {{(pid=110213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:41:32.025200 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG dbcounter [-] [110213] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:41:32.934225 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi [None req-bee8860a-2096-4b9d-9ff5-0e74a6b47e77 admin admin] Calling method '>' {{(pid=110213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:32.971444 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: INFO nova.api.openstack.requestlog [None req-bee8860a-2096-4b9d-9ff5-0e74a6b47e77 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.955140 Aug 09 18:41:32.972329 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: [pid: 110213|app: 0|req: 1/3] 10.222.0.57 () {60 vars in 1292 bytes} [Tue Aug 9 18:41:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:41:35.285482 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi [None req-d6c3db6d-67cf-42a9-9243-6d61532779d2 None None] Calling method '>' {{(pid=110214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:35.286588 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO nova.api.openstack.requestlog [None req-d6c3db6d-67cf-42a9-9243-6d61532779d2 None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Aug 09 18:41:35.286987 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: [pid: 110214|app: 0|req: 3/4] 10.222.0.57 () {54 vars in 931 bytes} [Tue Aug 9 18:41:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:41:35.762811 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi [None req-88256c6c-bf2a-4cf5-8237-26199eabeb3e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "swap": 0, "vcpus": 1, "name": "cirros256", "ram": 256}} {{(pid=110213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:41:35.783712 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 18:41:35.783712 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: warnings.warn(msg) Aug 09 18:41:35.866546 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: INFO nova.api.openstack.requestlog [None req-88256c6c-bf2a-4cf5-8237-26199eabeb3e admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.573022 Aug 09 18:41:35.867287 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: [pid: 110213|app: 0|req: 2/5] 10.222.0.57 () {64 vars in 1283 bytes} [Tue Aug 9 18:41:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:41:35.880741 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG dbcounter [-] [110214] Writing DB stats nova_api:SELECT=3 {{(pid=110214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:41:35.882260 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG dbcounter [-] [110214] Writing DB stats nova_cell1:SELECT=3 {{(pid=110214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:41:35.883284 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG dbcounter [-] [110214] Writing DB stats nova_cell0:SELECT=3 {{(pid=110214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:41:35.884157 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG dbcounter [-] [110214] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:41:36.093927 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi [None req-754e6247-4c60-4ea1-8b38-b1bf1cc83cf1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:41:36.097850 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 18:41:36.097850 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: warnings.warn(msg) Aug 09 18:41:36.207437 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO nova.api.openstack.requestlog [None req-754e6247-4c60-4ea1-8b38-b1bf1cc83cf1 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.331750 Aug 09 18:41:36.208584 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: [pid: 110214|app: 0|req: 4/6] 10.222.0.57 () {64 vars in 1336 bytes} [Tue Aug 9 18:41:35 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:41:38.464452 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi [None req-88256c6c-bf2a-4cf5-8237-26199eabeb3e admin admin] Calling method '>' {{(pid=110213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:38.467948 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: INFO nova.api.openstack.requestlog [None req-88256c6c-bf2a-4cf5-8237-26199eabeb3e admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004578 Aug 09 18:41:38.468531 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: [pid: 110213|app: 0|req: 3/7] 10.222.0.57 () {54 vars in 931 bytes} [Tue Aug 9 18:41:38 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:41:39.161989 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi [None req-43410195-ea38-4a88-8376-6b981094532c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "ram": 512, "vcpus": 1, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "disk": 5, "os-flavor-access:is_public": true}} {{(pid=110214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:41:39.182065 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 18:41:39.182065 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: warnings.warn(msg) Aug 09 18:41:39.280344 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO nova.api.openstack.requestlog [None req-43410195-ea38-4a88-8376-6b981094532c admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.805726 Aug 09 18:41:39.281318 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: [pid: 110214|app: 0|req: 5/8] 10.222.0.57 () {64 vars in 1283 bytes} [Tue Aug 9 18:41:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:41:39.295006 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi [None req-de737a54-c615-42ad-a304-ffad24a3ee0d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:41:39.298583 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 18:41:39.298583 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: warnings.warn(msg) Aug 09 18:41:39.405057 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: INFO nova.api.openstack.requestlog [None req-de737a54-c615-42ad-a304-ffad24a3ee0d admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114447 Aug 09 18:41:39.417085 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: [pid: 110213|app: 0|req: 4/9] 10.222.0.57 () {64 vars in 1336 bytes} [Tue Aug 9 18:41:39 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:41:41.687802 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi [None req-43410195-ea38-4a88-8376-6b981094532c admin admin] Calling method '>' {{(pid=110214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:41.688917 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO nova.api.openstack.requestlog [None req-43410195-ea38-4a88-8376-6b981094532c admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001593 Aug 09 18:41:41.689431 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: [pid: 110214|app: 0|req: 6/10] 10.222.0.57 () {54 vars in 931 bytes} [Tue Aug 9 18:41:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:41:42.089098 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi [None req-2dd8ecca-fe22-4892-9a2d-13e81e0abb9c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "ram": 1024, "id": "d2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:41:42.165154 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: INFO nova.api.openstack.requestlog [None req-2dd8ecca-fe22-4892-9a2d-13e81e0abb9c admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.469211 Aug 09 18:41:42.165605 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: [pid: 110213|app: 0|req: 5/11] 10.222.0.57 () {64 vars in 1283 bytes} [Tue Aug 9 18:41:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 18:41:42.177782 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi [None req-11cc3835-e523-4b9e-b87f-9e1c48cf5fb8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:41:42.248777 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO nova.api.openstack.requestlog [None req-11cc3835-e523-4b9e-b87f-9e1c48cf5fb8 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074532 Aug 09 18:41:42.249420 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: [pid: 110214|app: 0|req: 7/12] 10.222.0.57 () {64 vars in 1336 bytes} [Tue Aug 9 18:41:42 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:41:44.551594 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi [None req-2dd8ecca-fe22-4892-9a2d-13e81e0abb9c admin admin] Calling method '>' {{(pid=110213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:44.552536 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: INFO nova.api.openstack.requestlog [None req-2dd8ecca-fe22-4892-9a2d-13e81e0abb9c admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 09 18:41:44.552946 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: [pid: 110213|app: 0|req: 6/13] 10.222.0.57 () {54 vars in 931 bytes} [Tue Aug 9 18:41:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:41:45.015293 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi [None req-442b0b15-0bd5-4a08-bff2-5728c16aa369 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "rxtx_factor": 1.0, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 2, "swap": 0, "id": "d3", "ram": 2048}} {{(pid=110214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:41:45.097809 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO nova.api.openstack.requestlog [None req-442b0b15-0bd5-4a08-bff2-5728c16aa369 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.538635 Aug 09 18:41:45.098395 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: [pid: 110214|app: 0|req: 8/14] 10.222.0.57 () {64 vars in 1283 bytes} [Tue Aug 9 18:41:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 18:41:45.110781 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi [None req-f087c8a5-366e-4d68-aa4d-f11372ada762 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:41:45.198850 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: INFO nova.api.openstack.requestlog [None req-f087c8a5-366e-4d68-aa4d-f11372ada762 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091761 Aug 09 18:41:45.199741 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: [pid: 110213|app: 0|req: 7/15] 10.222.0.57 () {64 vars in 1336 bytes} [Tue Aug 9 18:41:45 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:41:47.467748 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi [None req-442b0b15-0bd5-4a08-bff2-5728c16aa369 admin admin] Calling method '>' {{(pid=110214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:47.468754 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO nova.api.openstack.requestlog [None req-442b0b15-0bd5-4a08-bff2-5728c16aa369 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Aug 09 18:41:47.469155 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: [pid: 110214|app: 0|req: 9/16] 10.222.0.57 () {54 vars in 931 bytes} [Tue Aug 9 18:41:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:41:47.937621 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi [None req-2efbeb97-bdee-430d-8c43-e1a2366b1a66 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "id": "d4", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "ram": 4096}} {{(pid=110213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:41:48.034820 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: INFO nova.api.openstack.requestlog [None req-2efbeb97-bdee-430d-8c43-e1a2366b1a66 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.559576 Aug 09 18:41:48.035364 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: [pid: 110213|app: 0|req: 8/17] 10.222.0.57 () {64 vars in 1283 bytes} [Tue Aug 9 18:41:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:41:48.047959 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi [None req-308b503a-4927-4809-9438-5d7134d4a2db admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:41:48.157484 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO nova.api.openstack.requestlog [None req-308b503a-4927-4809-9438-5d7134d4a2db admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113313 Aug 09 18:41:48.158297 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: [pid: 110214|app: 0|req: 10/18] 10.222.0.57 () {64 vars in 1336 bytes} [Tue Aug 9 18:41:48 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:41:50.431929 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi [None req-2efbeb97-bdee-430d-8c43-e1a2366b1a66 admin admin] Calling method '>' {{(pid=110213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:50.432992 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: INFO nova.api.openstack.requestlog [None req-2efbeb97-bdee-430d-8c43-e1a2366b1a66 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001567 Aug 09 18:41:50.433457 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: [pid: 110213|app: 0|req: 9/19] 10.222.0.57 () {54 vars in 931 bytes} [Tue Aug 9 18:41:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:41:50.865218 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi [None req-e6bfdd1d-b06c-4b3f-85a0-3540c51a8130 admin admin] Calling method '>' {{(pid=110214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:50.890382 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO nova.api.openstack.requestlog [None req-e6bfdd1d-b06c-4b3f-85a0-3540c51a8130 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.450791 Aug 09 18:41:50.890931 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: [pid: 110214|app: 0|req: 11/20] 10.222.0.57 () {60 vars in 1292 bytes} [Tue Aug 9 18:41:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:41:53.268608 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi [None req-2efbeb97-bdee-430d-8c43-e1a2366b1a66 admin admin] Calling method '>' {{(pid=110213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:53.270063 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: INFO nova.api.openstack.requestlog [None req-2efbeb97-bdee-430d-8c43-e1a2366b1a66 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001876 Aug 09 18:41:53.271276 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: [pid: 110213|app: 0|req: 10/21] 10.222.0.57 () {54 vars in 931 bytes} [Tue Aug 9 18:41:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:41:53.848481 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi [None req-4f2dc0f0-f7b9-4051-ab3d-ec61133e0e88 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.tiny", "vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "disk": 1, "id": "1"}} {{(pid=110214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:41:53.983234 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO nova.api.openstack.requestlog [None req-4f2dc0f0-f7b9-4051-ab3d-ec61133e0e88 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.702499 Aug 09 18:41:53.983889 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: [pid: 110214|app: 0|req: 12/22] 10.222.0.57 () {64 vars in 1283 bytes} [Tue Aug 9 18:41:53 2022] POST /compute/v2.1/flavors => generated 402 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:41:53.999354 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi [None req-9c45f517-1ad8-40e2-953d-6527fe31b0ad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:41:54.159253 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: INFO nova.api.openstack.requestlog [None req-9c45f517-1ad8-40e2-953d-6527fe31b0ad admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.163954 Aug 09 18:41:54.160611 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: [pid: 110213|app: 0|req: 11/23] 10.222.0.57 () {64 vars in 1333 bytes} [Tue Aug 9 18:41:53 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:41:56.411497 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi [None req-4f2dc0f0-f7b9-4051-ab3d-ec61133e0e88 admin admin] Calling method '>' {{(pid=110214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:56.412507 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO nova.api.openstack.requestlog [None req-4f2dc0f0-f7b9-4051-ab3d-ec61133e0e88 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 09 18:41:56.413140 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: [pid: 110214|app: 0|req: 13/24] 10.222.0.57 () {54 vars in 931 bytes} [Tue Aug 9 18:41:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:41:56.860483 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi [None req-0a60d021-dab9-4743-a2d1-971b702554c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "vcpus": 1, "os-flavor-access:is_public": true, "name": "m1.small", "ram": 2048}} {{(pid=110213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:41:56.943584 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: INFO nova.api.openstack.requestlog [None req-0a60d021-dab9-4743-a2d1-971b702554c9 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.524374 Aug 09 18:41:56.944145 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: [pid: 110213|app: 0|req: 12/25] 10.222.0.57 () {64 vars in 1283 bytes} [Tue Aug 9 18:41:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:41:56.956178 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi [None req-e5e7b85b-2642-4445-9cb5-eb9c0ee7477e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:41:57.037242 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO nova.api.openstack.requestlog [None req-e5e7b85b-2642-4445-9cb5-eb9c0ee7477e admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084764 Aug 09 18:41:57.037850 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: [pid: 110214|app: 0|req: 14/26] 10.222.0.57 () {64 vars in 1333 bytes} [Tue Aug 9 18:41:56 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:41:59.264489 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi [None req-0a60d021-dab9-4743-a2d1-971b702554c9 admin admin] Calling method '>' {{(pid=110213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:59.266181 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: INFO nova.api.openstack.requestlog [None req-0a60d021-dab9-4743-a2d1-971b702554c9 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002375 Aug 09 18:41:59.267070 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: [pid: 110213|app: 0|req: 13/27] 10.222.0.57 () {54 vars in 931 bytes} [Tue Aug 9 18:41:59 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:41:59.645687 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi [None req-c2c34e50-23a4-4ebf-8bfe-c6543036e27a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "3", "swap": 0, "name": "m1.medium", "os-flavor-access:is_public": true, "ram": 4096, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40}} {{(pid=110214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:41:59.736482 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO nova.api.openstack.requestlog [None req-c2c34e50-23a4-4ebf-8bfe-c6543036e27a admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.462829 Aug 09 18:41:59.737201 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: [pid: 110214|app: 0|req: 15/28] 10.222.0.57 () {64 vars in 1283 bytes} [Tue Aug 9 18:41:59 2022] POST /compute/v2.1/flavors => generated 406 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:41:59.749555 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi [None req-2c79e987-135a-409c-9ed0-42a45b9a72d6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:41:59.855075 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: INFO nova.api.openstack.requestlog [None req-2c79e987-135a-409c-9ed0-42a45b9a72d6 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109177 Aug 09 18:41:59.856063 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: [pid: 110213|app: 0|req: 14/29] 10.222.0.57 () {64 vars in 1333 bytes} [Tue Aug 9 18:41:59 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:42:02.109763 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi [None req-c2c34e50-23a4-4ebf-8bfe-c6543036e27a admin admin] Calling method '>' {{(pid=110214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:42:02.110794 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO nova.api.openstack.requestlog [None req-c2c34e50-23a4-4ebf-8bfe-c6543036e27a admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001582 Aug 09 18:42:02.111210 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: [pid: 110214|app: 0|req: 16/30] 10.222.0.57 () {54 vars in 931 bytes} [Tue Aug 9 18:42:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:42:02.591857 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi [None req-a146da47-5de4-4a66-b9b7-d3d0d3323340 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "id": "4", "swap": 0, "vcpus": 4, "disk": 80, "rxtx_factor": 1.0, "ram": 8192, "os-flavor-access:is_public": true}} {{(pid=110213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:42:02.597729 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG dbcounter [-] [110213] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=110213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:42:02.673987 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: INFO nova.api.openstack.requestlog [None req-a146da47-5de4-4a66-b9b7-d3d0d3323340 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.553514 Aug 09 18:42:02.674680 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: [pid: 110213|app: 0|req: 15/31] 10.222.0.57 () {64 vars in 1283 bytes} [Tue Aug 9 18:42:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:42:02.687406 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi [None req-8cd23269-c443-4526-93a5-9751635acc76 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:42:02.776680 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO nova.api.openstack.requestlog [None req-8cd23269-c443-4526-93a5-9751635acc76 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093198 Aug 09 18:42:02.777378 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: [pid: 110214|app: 0|req: 17/32] 10.222.0.57 () {64 vars in 1333 bytes} [Tue Aug 9 18:42:02 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:42:05.116627 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi [None req-a146da47-5de4-4a66-b9b7-d3d0d3323340 admin admin] Calling method '>' {{(pid=110213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:42:05.117679 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: INFO nova.api.openstack.requestlog [None req-a146da47-5de4-4a66-b9b7-d3d0d3323340 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002027 Aug 09 18:42:05.118080 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: [pid: 110213|app: 0|req: 16/33] 10.222.0.57 () {54 vars in 931 bytes} [Tue Aug 9 18:42:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:42:05.614971 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi [None req-78614492-767f-4989-a741-fa96087c7824 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "swap": 0, "rxtx_factor": 1.0, "ram": 16384, "disk": 160, "os-flavor-access:is_public": true, "id": "5"}} {{(pid=110214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:42:05.696985 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO nova.api.openstack.requestlog [None req-78614492-767f-4989-a741-fa96087c7824 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.572025 Aug 09 18:42:05.698101 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: [pid: 110214|app: 0|req: 18/34] 10.222.0.57 () {64 vars in 1283 bytes} [Tue Aug 9 18:42:05 2022] POST /compute/v2.1/flavors => generated 408 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:42:05.710854 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi [None req-baa9266e-037c-462d-a5b4-450e9cd173bb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:42:05.809577 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: INFO nova.api.openstack.requestlog [None req-baa9266e-037c-462d-a5b4-450e9cd173bb admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102728 Aug 09 18:42:05.821783 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: [pid: 110213|app: 0|req: 17/35] 10.222.0.57 () {64 vars in 1333 bytes} [Tue Aug 9 18:42:05 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:42:26.322753 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi [None req-78614492-767f-4989-a741-fa96087c7824 admin admin] Calling method '>' {{(pid=110214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:42:26.323756 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO nova.api.openstack.requestlog [None req-78614492-767f-4989-a741-fa96087c7824 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 09 18:42:26.324152 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: [pid: 110214|app: 0|req: 19/36] 10.222.0.57 () {54 vars in 931 bytes} [Tue Aug 9 18:42:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:42:26.724230 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi [None req-5fa5138d-3b95-400f-916f-03c23c3fb736 admin admin] Calling method '>' {{(pid=110213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:42:26.743929 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: INFO nova.api.openstack.requestlog [None req-5fa5138d-3b95-400f-916f-03c23c3fb736 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.413440 Aug 09 18:42:26.744364 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: [pid: 110213|app: 0|req: 18/37] 10.222.0.57 () {60 vars in 1292 bytes} [Tue Aug 9 18:42:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:42:27.810367 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi [None req-78614492-767f-4989-a741-fa96087c7824 admin admin] Calling method '>' {{(pid=110214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:42:27.811361 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO nova.api.openstack.requestlog [None req-78614492-767f-4989-a741-fa96087c7824 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 09 18:42:27.811783 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: [pid: 110214|app: 0|req: 20/38] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Aug 9 18:42:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:42:28.356263 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi [None req-ab8505d6-8819-4754-ab58-3a33c4ef0bbe admin admin] Calling method '>' {{(pid=110213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:42:28.361935 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: INFO nova.api.openstack.wsgi [None req-ab8505d6-8819-4754-ab58-3a33c4ef0bbe admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 09 18:42:28.365188 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi [None req-ab8505d6-8819-4754-ab58-3a33c4ef0bbe admin admin] Request method failure captured: Aug 09 18:42:28.365188 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 09 18:42:28.365188 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: Accept: application/json Aug 09 18:42:28.365188 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: Accept-Encoding: gzip, deflate Aug 09 18:42:28.365188 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: Connection: keep-alive Aug 09 18:42:28.365188 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: Content-Length: 0 Aug 09 18:42:28.365188 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: Host: 10.222.0.57 Aug 09 18:42:28.365188 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: Openstack-Api-Version: compute 2.90 Aug 09 18:42:28.365188 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: Openstack-System-Scope: None Aug 09 18:42:28.365188 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: User-Agent: python-novaclient Aug 09 18:42:28.365188 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Auth-Token: gAAAAABi8qqTHH-hmg0OpQbZtP31X_BZd92_9NrAMDJNVTY2firxwP4fRDxGHG5IBVQk-UsWit0eTy0Q-52ysRZ3c6cLVp3AJ2qDSHisn5EhvFpKpoX1qZP4RuTorTC4c_LMtI0jGQpU4U4zK6OixNV6Zoq3ZdIS6ZNAY9Pm5-wXMxYsNWVBR_k Aug 09 18:42:28.365188 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Domain-Id: None Aug 09 18:42:28.365188 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Domain-Name: None Aug 09 18:42:28.365188 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Identity-Status: Confirmed Aug 09 18:42:28.365188 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Is-Admin-Project: True Aug 09 18:42:28.365188 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 18:42:28.365188 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Project-Domain-Id: default Aug 09 18:42:28.365188 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Project-Domain-Name: Default Aug 09 18:42:28.365188 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Project-Id: ee70c279239f4e719fad35784db1a619 Aug 09 18:42:28.365188 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Project-Name: admin Aug 09 18:42:28.365188 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Role: reader,member,admin Aug 09 18:42:28.365188 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Roles: reader,member,admin Aug 09 18:42:28.367484 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ee70c279239f4e719fad35784db1a619", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ee70c279239f4e719fad35784db1a619"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ee70c279239f4e719fad35784db1a619"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ee70c279239f4e719fad35784db1a619"}]}] Aug 09 18:42:28.367484 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Tenant: admin Aug 09 18:42:28.367484 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Tenant-Id: ee70c279239f4e719fad35784db1a619 Aug 09 18:42:28.367484 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Tenant-Name: admin Aug 09 18:42:28.367484 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-User: admin Aug 09 18:42:28.367484 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-User-Domain-Id: default Aug 09 18:42:28.367484 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-User-Domain-Name: Default Aug 09 18:42:28.367484 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-User-Id: 7a379f0e1f1f4c9c884081f682310ad9 Aug 09 18:42:28.367484 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-User-Name: admin Aug 09 18:42:28.367484 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: method: > Aug 09 18:42:28.367484 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: exception: Flavor 42 could not be found. Aug 09 18:42:28.367484 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: action_args: {'id': '42'} Aug 09 18:42:28.367484 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: {{(pid=110213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:42:28.367484 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:42:28.368719 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 18:42:28.368719 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 18:42:28.368719 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 18:42:28.368719 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 18:42:28.368719 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 18:42:28.368719 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 18:42:28.368719 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 18:42:28.368719 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 18:42:28.368719 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 18:42:28.368719 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:42:28.368719 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 18:42:28.368719 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 18:42:28.368719 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 09 18:42:28.368719 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi Aug 09 18:42:28.368719 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:42:28.368719 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi Aug 09 18:42:28.368719 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:42:28.368719 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:42:28.368719 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:42:28.370341 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:42:28.370341 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:42:28.370341 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:42:28.370341 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:42:28.370341 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 18:42:28.370341 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:42:28.370341 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 09 18:42:28.370341 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi Aug 09 18:42:28.370341 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:42:28.370341 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi Aug 09 18:42:28.370341 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:42:28.370341 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:42:28.370341 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:42:28.370341 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:42:28.370341 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:42:28.370341 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 09 18:42:28.370341 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi Aug 09 18:42:28.370341 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi [None req-ab8505d6-8819-4754-ab58-3a33c4ef0bbe admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110213) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:42:28.371612 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: INFO nova.api.openstack.requestlog [None req-ab8505d6-8819-4754-ab58-3a33c4ef0bbe admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.414774 Aug 09 18:42:28.371612 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: [pid: 110213|app: 0|req: 19/39] 10.222.0.57 () {60 vars in 1190 bytes} [Tue Aug 9 18:42:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 416 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 18:42:28.377039 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi [None req-518f7c4a-488b-47f6-9a84-e023e4ff1b63 admin admin] Calling method '>' {{(pid=110214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:42:28.381206 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG dbcounter [-] [110214] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:42:28.400137 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO nova.api.openstack.requestlog [None req-518f7c4a-488b-47f6-9a84-e023e4ff1b63 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026685 Aug 09 18:42:28.401019 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: [pid: 110214|app: 0|req: 21/40] 10.222.0.57 () {60 vars in 1210 bytes} [Tue Aug 9 18:42:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:42:28.410821 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi [None req-a99e15bc-17ef-4163-b3ba-e711d4f2a636 admin admin] Calling method '>' {{(pid=110213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:42:28.435614 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: INFO nova.api.openstack.requestlog [None req-a99e15bc-17ef-4163-b3ba-e711d4f2a636 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028503 Aug 09 18:42:28.436153 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: [pid: 110213|app: 0|req: 20/41] 10.222.0.57 () {60 vars in 1210 bytes} [Tue Aug 9 18:42:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:42:28.445960 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi [None req-a3f54bba-f213-4872-a287-267f530e72fa admin admin] Calling method '>' {{(pid=110214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:42:28.451635 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO nova.api.openstack.wsgi [None req-a3f54bba-f213-4872-a287-267f530e72fa admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 09 18:42:28.454903 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi [None req-a3f54bba-f213-4872-a287-267f530e72fa admin admin] Request method failure captured: Aug 09 18:42:28.454903 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 09 18:42:28.454903 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: Accept: application/json Aug 09 18:42:28.454903 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: Accept-Encoding: gzip, deflate Aug 09 18:42:28.454903 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: Connection: keep-alive Aug 09 18:42:28.454903 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: Content-Length: 0 Aug 09 18:42:28.454903 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: Host: 10.222.0.57 Aug 09 18:42:28.454903 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: Openstack-Api-Version: compute 2.90 Aug 09 18:42:28.454903 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: Openstack-System-Scope: None Aug 09 18:42:28.454903 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: User-Agent: python-novaclient Aug 09 18:42:28.454903 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Auth-Token: gAAAAABi8qqTHH-hmg0OpQbZtP31X_BZd92_9NrAMDJNVTY2firxwP4fRDxGHG5IBVQk-UsWit0eTy0Q-52ysRZ3c6cLVp3AJ2qDSHisn5EhvFpKpoX1qZP4RuTorTC4c_LMtI0jGQpU4U4zK6OixNV6Zoq3ZdIS6ZNAY9Pm5-wXMxYsNWVBR_k Aug 09 18:42:28.454903 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Domain-Id: None Aug 09 18:42:28.454903 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Domain-Name: None Aug 09 18:42:28.454903 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Identity-Status: Confirmed Aug 09 18:42:28.454903 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Is-Admin-Project: True Aug 09 18:42:28.454903 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 18:42:28.454903 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Project-Domain-Id: default Aug 09 18:42:28.454903 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Project-Domain-Name: Default Aug 09 18:42:28.454903 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Project-Id: ee70c279239f4e719fad35784db1a619 Aug 09 18:42:28.454903 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Project-Name: admin Aug 09 18:42:28.454903 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Role: reader,member,admin Aug 09 18:42:28.454903 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Roles: reader,member,admin Aug 09 18:42:28.466663 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ee70c279239f4e719fad35784db1a619", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ee70c279239f4e719fad35784db1a619"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ee70c279239f4e719fad35784db1a619"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ee70c279239f4e719fad35784db1a619"}]}] Aug 09 18:42:28.466663 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Tenant: admin Aug 09 18:42:28.466663 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Tenant-Id: ee70c279239f4e719fad35784db1a619 Aug 09 18:42:28.466663 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Tenant-Name: admin Aug 09 18:42:28.466663 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-User: admin Aug 09 18:42:28.466663 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-User-Domain-Id: default Aug 09 18:42:28.466663 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-User-Domain-Name: Default Aug 09 18:42:28.466663 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-User-Id: 7a379f0e1f1f4c9c884081f682310ad9 Aug 09 18:42:28.466663 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-User-Name: admin Aug 09 18:42:28.466663 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: method: > Aug 09 18:42:28.466663 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: exception: Flavor 42 could not be found. Aug 09 18:42:28.466663 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: action_args: {'id': '42'} Aug 09 18:42:28.466663 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: {{(pid=110214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:42:28.466663 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:42:28.467726 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 18:42:28.467726 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 18:42:28.467726 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 18:42:28.467726 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 18:42:28.467726 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 18:42:28.467726 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 18:42:28.467726 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 18:42:28.467726 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 18:42:28.467726 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 18:42:28.467726 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:42:28.467726 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 18:42:28.467726 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 18:42:28.467726 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 09 18:42:28.467726 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi Aug 09 18:42:28.467726 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:42:28.467726 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi Aug 09 18:42:28.467726 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:42:28.467726 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:42:28.467726 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:42:28.468985 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:42:28.468985 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:42:28.468985 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:42:28.468985 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:42:28.468985 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 18:42:28.468985 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:42:28.468985 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 09 18:42:28.468985 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi Aug 09 18:42:28.468985 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:42:28.468985 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi Aug 09 18:42:28.468985 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:42:28.468985 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:42:28.468985 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:42:28.468985 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:42:28.468985 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:42:28.468985 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 09 18:42:28.468985 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi Aug 09 18:42:28.468985 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi [None req-a3f54bba-f213-4872-a287-267f530e72fa admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110214) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:42:28.470265 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO nova.api.openstack.requestlog [None req-a3f54bba-f213-4872-a287-267f530e72fa admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014192 Aug 09 18:42:28.470265 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: [pid: 110214|app: 0|req: 22/42] 10.222.0.57 () {60 vars in 1190 bytes} [Tue Aug 9 18:42:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 18:42:29.426703 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi [None req-a99e15bc-17ef-4163-b3ba-e711d4f2a636 admin admin] Calling method '>' {{(pid=110213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:42:29.427735 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: INFO nova.api.openstack.requestlog [None req-a99e15bc-17ef-4163-b3ba-e711d4f2a636 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 09 18:42:29.428983 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: [pid: 110213|app: 0|req: 21/43] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Aug 9 18:42:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:42:29.964195 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi [None req-e96a06aa-d872-4e0b-9645-33c58abc4da0 admin admin] Calling method '>' {{(pid=110214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:42:29.969509 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO nova.api.openstack.wsgi [None req-e96a06aa-d872-4e0b-9645-33c58abc4da0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 09 18:42:29.971029 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi [None req-e96a06aa-d872-4e0b-9645-33c58abc4da0 admin admin] Request method failure captured: Aug 09 18:42:29.971029 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 09 18:42:29.971029 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: Accept: application/json Aug 09 18:42:29.971029 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: Accept-Encoding: gzip, deflate Aug 09 18:42:29.971029 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: Connection: keep-alive Aug 09 18:42:29.971029 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: Content-Length: 0 Aug 09 18:42:29.971029 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: Host: 10.222.0.57 Aug 09 18:42:29.971029 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: Openstack-Api-Version: compute 2.90 Aug 09 18:42:29.971029 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: Openstack-System-Scope: None Aug 09 18:42:29.971029 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: User-Agent: python-novaclient Aug 09 18:42:29.971029 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Auth-Token: gAAAAABi8qqV4N3MX08VsIBTFbF1eiyPYP95VBxb2hfBQWNUwPfdSaHBMUHBkez5IXDElMrgMnmdBHCZJvPONi3tIDQKN80QEC8P-q5fHQApZ6DZX7dx0WKFGIEqUW_78hfZ2qMBmQqEA2eWU91JwB4pSumDsJb_Ahnh6ZgLQCS3vM-GStstxzA Aug 09 18:42:29.971029 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Domain-Id: None Aug 09 18:42:29.971029 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Domain-Name: None Aug 09 18:42:29.971029 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Identity-Status: Confirmed Aug 09 18:42:29.971029 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Is-Admin-Project: True Aug 09 18:42:29.971029 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 18:42:29.971029 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Project-Domain-Id: default Aug 09 18:42:29.971029 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Project-Domain-Name: Default Aug 09 18:42:29.971029 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Project-Id: ee70c279239f4e719fad35784db1a619 Aug 09 18:42:29.971029 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Project-Name: admin Aug 09 18:42:29.971029 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Role: reader,member,admin Aug 09 18:42:29.971029 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Roles: reader,member,admin Aug 09 18:42:29.972625 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ee70c279239f4e719fad35784db1a619", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ee70c279239f4e719fad35784db1a619"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ee70c279239f4e719fad35784db1a619"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ee70c279239f4e719fad35784db1a619"}]}] Aug 09 18:42:29.972625 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Tenant: admin Aug 09 18:42:29.972625 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Tenant-Id: ee70c279239f4e719fad35784db1a619 Aug 09 18:42:29.972625 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Tenant-Name: admin Aug 09 18:42:29.972625 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-User: admin Aug 09 18:42:29.972625 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-User-Domain-Id: default Aug 09 18:42:29.972625 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-User-Domain-Name: Default Aug 09 18:42:29.972625 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-User-Id: 7a379f0e1f1f4c9c884081f682310ad9 Aug 09 18:42:29.972625 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-User-Name: admin Aug 09 18:42:29.972625 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: method: > Aug 09 18:42:29.972625 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: exception: Flavor 84 could not be found. Aug 09 18:42:29.972625 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: action_args: {'id': '84'} Aug 09 18:42:29.972625 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: {{(pid=110214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:42:29.972625 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:42:29.973636 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 18:42:29.973636 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 18:42:29.973636 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 18:42:29.973636 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 18:42:29.973636 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 18:42:29.973636 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 18:42:29.973636 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 18:42:29.973636 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 18:42:29.973636 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 18:42:29.973636 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:42:29.973636 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 18:42:29.973636 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 18:42:29.973636 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 09 18:42:29.973636 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi Aug 09 18:42:29.973636 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:42:29.973636 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi Aug 09 18:42:29.973636 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:42:29.973636 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:42:29.973636 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:42:29.975098 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:42:29.975098 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:42:29.975098 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:42:29.975098 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:42:29.975098 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 18:42:29.975098 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:42:29.975098 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 09 18:42:29.975098 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi Aug 09 18:42:29.975098 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:42:29.975098 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi Aug 09 18:42:29.975098 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:42:29.975098 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:42:29.975098 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:42:29.975098 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:42:29.975098 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:42:29.975098 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 09 18:42:29.975098 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi Aug 09 18:42:29.975098 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi [None req-e96a06aa-d872-4e0b-9645-33c58abc4da0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110214) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:42:29.976347 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO nova.api.openstack.requestlog [None req-e96a06aa-d872-4e0b-9645-33c58abc4da0 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.403381 Aug 09 18:42:29.976347 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: [pid: 110214|app: 0|req: 23/44] 10.222.0.57 () {60 vars in 1190 bytes} [Tue Aug 9 18:42:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 18:42:29.981969 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi [None req-be70b0ef-15c9-40e4-8498-37d51bc22be1 admin admin] Calling method '>' {{(pid=110213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:42:29.997022 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: INFO nova.api.openstack.requestlog [None req-be70b0ef-15c9-40e4-8498-37d51bc22be1 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018559 Aug 09 18:42:29.997599 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: [pid: 110213|app: 0|req: 22/45] 10.222.0.57 () {60 vars in 1210 bytes} [Tue Aug 9 18:42:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:42:30.007780 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi [None req-1fd112b4-647e-40fb-8c46-6ded22c434f6 admin admin] Calling method '>' {{(pid=110214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:42:30.022906 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO nova.api.openstack.requestlog [None req-1fd112b4-647e-40fb-8c46-6ded22c434f6 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019295 Aug 09 18:42:30.023441 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: [pid: 110214|app: 0|req: 24/46] 10.222.0.57 () {60 vars in 1210 bytes} [Tue Aug 9 18:42:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:42:30.032748 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi [None req-267613e2-4a00-4a26-9a40-7f9af0f8b0d3 admin admin] Calling method '>' {{(pid=110213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:42:30.038016 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: INFO nova.api.openstack.wsgi [None req-267613e2-4a00-4a26-9a40-7f9af0f8b0d3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 09 18:42:30.039505 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi [None req-267613e2-4a00-4a26-9a40-7f9af0f8b0d3 admin admin] Request method failure captured: Aug 09 18:42:30.039505 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 09 18:42:30.039505 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: Accept: application/json Aug 09 18:42:30.039505 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: Accept-Encoding: gzip, deflate Aug 09 18:42:30.039505 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: Connection: keep-alive Aug 09 18:42:30.039505 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: Content-Length: 0 Aug 09 18:42:30.039505 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: Host: 10.222.0.57 Aug 09 18:42:30.039505 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: Openstack-Api-Version: compute 2.90 Aug 09 18:42:30.039505 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: Openstack-System-Scope: None Aug 09 18:42:30.039505 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: User-Agent: python-novaclient Aug 09 18:42:30.039505 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Auth-Token: gAAAAABi8qqV4N3MX08VsIBTFbF1eiyPYP95VBxb2hfBQWNUwPfdSaHBMUHBkez5IXDElMrgMnmdBHCZJvPONi3tIDQKN80QEC8P-q5fHQApZ6DZX7dx0WKFGIEqUW_78hfZ2qMBmQqEA2eWU91JwB4pSumDsJb_Ahnh6ZgLQCS3vM-GStstxzA Aug 09 18:42:30.039505 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Domain-Id: None Aug 09 18:42:30.039505 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Domain-Name: None Aug 09 18:42:30.039505 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Identity-Status: Confirmed Aug 09 18:42:30.039505 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Is-Admin-Project: True Aug 09 18:42:30.039505 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 18:42:30.039505 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Project-Domain-Id: default Aug 09 18:42:30.039505 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Project-Domain-Name: Default Aug 09 18:42:30.039505 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Project-Id: ee70c279239f4e719fad35784db1a619 Aug 09 18:42:30.039505 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Project-Name: admin Aug 09 18:42:30.039505 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Role: reader,member,admin Aug 09 18:42:30.039505 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Roles: reader,member,admin Aug 09 18:42:30.041144 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ee70c279239f4e719fad35784db1a619", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ee70c279239f4e719fad35784db1a619"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ee70c279239f4e719fad35784db1a619"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ee70c279239f4e719fad35784db1a619"}]}] Aug 09 18:42:30.041144 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Tenant: admin Aug 09 18:42:30.041144 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Tenant-Id: ee70c279239f4e719fad35784db1a619 Aug 09 18:42:30.041144 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Tenant-Name: admin Aug 09 18:42:30.041144 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-User: admin Aug 09 18:42:30.041144 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-User-Domain-Id: default Aug 09 18:42:30.041144 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-User-Domain-Name: Default Aug 09 18:42:30.041144 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-User-Id: 7a379f0e1f1f4c9c884081f682310ad9 Aug 09 18:42:30.041144 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-User-Name: admin Aug 09 18:42:30.041144 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: method: > Aug 09 18:42:30.041144 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: exception: Flavor 84 could not be found. Aug 09 18:42:30.041144 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: action_args: {'id': '84'} Aug 09 18:42:30.041144 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: {{(pid=110213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:42:30.041144 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:42:30.042291 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 18:42:30.042291 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 18:42:30.042291 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 18:42:30.042291 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 18:42:30.042291 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 18:42:30.042291 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 18:42:30.042291 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 18:42:30.042291 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 18:42:30.042291 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 18:42:30.042291 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:42:30.042291 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 18:42:30.042291 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 18:42:30.042291 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 09 18:42:30.042291 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi Aug 09 18:42:30.042291 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:42:30.042291 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi Aug 09 18:42:30.042291 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:42:30.042291 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:42:30.042291 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:42:30.043585 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:42:30.043585 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:42:30.043585 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:42:30.043585 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:42:30.043585 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 18:42:30.043585 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:42:30.043585 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 09 18:42:30.043585 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi Aug 09 18:42:30.043585 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:42:30.043585 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi Aug 09 18:42:30.043585 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:42:30.043585 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:42:30.043585 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:42:30.043585 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:42:30.043585 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:42:30.043585 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 09 18:42:30.043585 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi Aug 09 18:42:30.043585 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi [None req-267613e2-4a00-4a26-9a40-7f9af0f8b0d3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110213) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:42:30.044795 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: INFO nova.api.openstack.requestlog [None req-267613e2-4a00-4a26-9a40-7f9af0f8b0d3 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011631 Aug 09 18:42:30.044795 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: [pid: 110213|app: 0|req: 23/47] 10.222.0.57 () {60 vars in 1190 bytes} [Tue Aug 9 18:42:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 18:42:31.023560 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi [None req-1fd112b4-647e-40fb-8c46-6ded22c434f6 admin admin] Calling method '>' {{(pid=110214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:42:31.024560 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO nova.api.openstack.requestlog [None req-1fd112b4-647e-40fb-8c46-6ded22c434f6 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 09 18:42:31.024955 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: [pid: 110214|app: 0|req: 25/48] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Aug 9 18:42:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:42:31.554687 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi [None req-504d3a36-7a17-4b4a-b09b-be5ece75dc13 admin admin] Calling method '>' {{(pid=110213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:42:31.561772 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: INFO nova.api.openstack.wsgi [None req-504d3a36-7a17-4b4a-b09b-be5ece75dc13 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 09 18:42:31.563258 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi [None req-504d3a36-7a17-4b4a-b09b-be5ece75dc13 admin admin] Request method failure captured: Aug 09 18:42:31.563258 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 09 18:42:31.563258 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: Accept: application/json Aug 09 18:42:31.563258 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: Accept-Encoding: gzip, deflate Aug 09 18:42:31.563258 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: Connection: keep-alive Aug 09 18:42:31.563258 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: Content-Length: 0 Aug 09 18:42:31.563258 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: Host: 10.222.0.57 Aug 09 18:42:31.563258 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: Openstack-Api-Version: compute 2.90 Aug 09 18:42:31.563258 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: Openstack-System-Scope: None Aug 09 18:42:31.563258 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: User-Agent: python-novaclient Aug 09 18:42:31.563258 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Auth-Token: gAAAAABi8qqW2mcIte8gsCFLXoxPABLYSW_A33DeVUoVdjAD4KsiVQWh8cE4DQyFO8_rUainko07OxTlpZETIW2W1sWGrEr1lzHjIFo-bPwXFPXOrJlbMX14xwn-qa5fH-Sa4lpbdwxItRkTZtsSRos_pc84pRbE7ADebY50w46u76LVcAILV1M Aug 09 18:42:31.563258 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Domain-Id: None Aug 09 18:42:31.563258 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Domain-Name: None Aug 09 18:42:31.563258 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Identity-Status: Confirmed Aug 09 18:42:31.563258 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Is-Admin-Project: True Aug 09 18:42:31.563258 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 18:42:31.563258 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Project-Domain-Id: default Aug 09 18:42:31.563258 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Project-Domain-Name: Default Aug 09 18:42:31.563258 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Project-Id: ee70c279239f4e719fad35784db1a619 Aug 09 18:42:31.563258 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Project-Name: admin Aug 09 18:42:31.563258 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Role: reader,member,admin Aug 09 18:42:31.563258 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Roles: reader,member,admin Aug 09 18:42:31.564823 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ee70c279239f4e719fad35784db1a619", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ee70c279239f4e719fad35784db1a619"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ee70c279239f4e719fad35784db1a619"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ee70c279239f4e719fad35784db1a619"}]}] Aug 09 18:42:31.564823 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Tenant: admin Aug 09 18:42:31.564823 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Tenant-Id: ee70c279239f4e719fad35784db1a619 Aug 09 18:42:31.564823 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-Tenant-Name: admin Aug 09 18:42:31.564823 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-User: admin Aug 09 18:42:31.564823 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-User-Domain-Id: default Aug 09 18:42:31.564823 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-User-Domain-Name: Default Aug 09 18:42:31.564823 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-User-Id: 7a379f0e1f1f4c9c884081f682310ad9 Aug 09 18:42:31.564823 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: X-User-Name: admin Aug 09 18:42:31.564823 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: method: > Aug 09 18:42:31.564823 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: exception: Flavor 451 could not be found. Aug 09 18:42:31.564823 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: action_args: {'id': '451'} Aug 09 18:42:31.564823 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: {{(pid=110213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:42:31.564823 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:42:31.565865 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 18:42:31.565865 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 18:42:31.565865 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 18:42:31.565865 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 18:42:31.565865 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 18:42:31.565865 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 18:42:31.565865 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 18:42:31.565865 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 18:42:31.565865 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 18:42:31.565865 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:42:31.565865 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 18:42:31.565865 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 18:42:31.565865 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 09 18:42:31.565865 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi Aug 09 18:42:31.565865 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:42:31.565865 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi Aug 09 18:42:31.565865 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:42:31.565865 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:42:31.565865 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:42:31.567278 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:42:31.567278 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:42:31.567278 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:42:31.567278 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:42:31.567278 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 18:42:31.567278 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:42:31.567278 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 09 18:42:31.567278 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi Aug 09 18:42:31.567278 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:42:31.567278 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi Aug 09 18:42:31.567278 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:42:31.567278 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:42:31.567278 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:42:31.567278 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:42:31.567278 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:42:31.567278 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 09 18:42:31.567278 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: ERROR nova.api.openstack.wsgi Aug 09 18:42:31.567278 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi [None req-504d3a36-7a17-4b4a-b09b-be5ece75dc13 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110213) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:42:31.568576 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: INFO nova.api.openstack.requestlog [None req-504d3a36-7a17-4b4a-b09b-be5ece75dc13 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.399775 Aug 09 18:42:31.568576 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: [pid: 110213|app: 0|req: 24/49] 10.222.0.57 () {60 vars in 1193 bytes} [Tue Aug 9 18:42:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 401 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 18:42:31.574238 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi [None req-a153cf86-9358-45cc-98eb-162f9a3b8602 admin admin] Calling method '>' {{(pid=110214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:42:31.590056 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO nova.api.openstack.requestlog [None req-a153cf86-9358-45cc-98eb-162f9a3b8602 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019341 Aug 09 18:42:31.590600 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: [pid: 110214|app: 0|req: 26/50] 10.222.0.57 () {60 vars in 1210 bytes} [Tue Aug 9 18:42:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:42:31.600879 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi [None req-a1d59d29-bbff-4a06-a772-a5b7f1e8b6ba admin admin] Calling method '>' {{(pid=110213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:42:31.616117 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: INFO nova.api.openstack.requestlog [None req-a1d59d29-bbff-4a06-a772-a5b7f1e8b6ba admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018819 Aug 09 18:42:31.616658 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: [pid: 110213|app: 0|req: 25/51] 10.222.0.57 () {60 vars in 1210 bytes} [Tue Aug 9 18:42:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:42:31.630156 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi [None req-e30aab8a-514d-43a7-8746-14847483f0fd admin admin] Calling method '>' {{(pid=110214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:42:31.636282 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO nova.api.openstack.wsgi [None req-e30aab8a-514d-43a7-8746-14847483f0fd admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 09 18:42:31.637823 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi [None req-e30aab8a-514d-43a7-8746-14847483f0fd admin admin] Request method failure captured: Aug 09 18:42:31.637823 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 09 18:42:31.637823 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: Accept: application/json Aug 09 18:42:31.637823 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: Accept-Encoding: gzip, deflate Aug 09 18:42:31.637823 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: Connection: keep-alive Aug 09 18:42:31.637823 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: Content-Length: 0 Aug 09 18:42:31.637823 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: Host: 10.222.0.57 Aug 09 18:42:31.637823 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: Openstack-Api-Version: compute 2.90 Aug 09 18:42:31.637823 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: Openstack-System-Scope: None Aug 09 18:42:31.637823 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: User-Agent: python-novaclient Aug 09 18:42:31.637823 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Auth-Token: gAAAAABi8qqW2mcIte8gsCFLXoxPABLYSW_A33DeVUoVdjAD4KsiVQWh8cE4DQyFO8_rUainko07OxTlpZETIW2W1sWGrEr1lzHjIFo-bPwXFPXOrJlbMX14xwn-qa5fH-Sa4lpbdwxItRkTZtsSRos_pc84pRbE7ADebY50w46u76LVcAILV1M Aug 09 18:42:31.637823 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Domain-Id: None Aug 09 18:42:31.637823 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Domain-Name: None Aug 09 18:42:31.637823 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Identity-Status: Confirmed Aug 09 18:42:31.637823 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Is-Admin-Project: True Aug 09 18:42:31.637823 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 18:42:31.637823 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Project-Domain-Id: default Aug 09 18:42:31.637823 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Project-Domain-Name: Default Aug 09 18:42:31.637823 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Project-Id: ee70c279239f4e719fad35784db1a619 Aug 09 18:42:31.637823 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Project-Name: admin Aug 09 18:42:31.637823 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Role: reader,member,admin Aug 09 18:42:31.637823 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Roles: reader,member,admin Aug 09 18:42:31.639452 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ee70c279239f4e719fad35784db1a619", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ee70c279239f4e719fad35784db1a619"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ee70c279239f4e719fad35784db1a619"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ee70c279239f4e719fad35784db1a619"}]}] Aug 09 18:42:31.639452 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Tenant: admin Aug 09 18:42:31.639452 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Tenant-Id: ee70c279239f4e719fad35784db1a619 Aug 09 18:42:31.639452 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-Tenant-Name: admin Aug 09 18:42:31.639452 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-User: admin Aug 09 18:42:31.639452 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-User-Domain-Id: default Aug 09 18:42:31.639452 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-User-Domain-Name: Default Aug 09 18:42:31.639452 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-User-Id: 7a379f0e1f1f4c9c884081f682310ad9 Aug 09 18:42:31.639452 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: X-User-Name: admin Aug 09 18:42:31.639452 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: method: > Aug 09 18:42:31.639452 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: exception: Flavor 451 could not be found. Aug 09 18:42:31.639452 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: action_args: {'id': '451'} Aug 09 18:42:31.639452 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: {{(pid=110214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:42:31.639452 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:42:31.640439 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 18:42:31.640439 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 18:42:31.640439 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 18:42:31.640439 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 18:42:31.640439 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 18:42:31.640439 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 18:42:31.640439 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 18:42:31.640439 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 18:42:31.640439 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 18:42:31.640439 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:42:31.640439 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 18:42:31.640439 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 18:42:31.640439 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 09 18:42:31.640439 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi Aug 09 18:42:31.640439 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:42:31.640439 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi Aug 09 18:42:31.640439 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:42:31.640439 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:42:31.640439 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:42:31.641926 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:42:31.641926 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:42:31.641926 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:42:31.641926 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:42:31.641926 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 18:42:31.641926 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:42:31.641926 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 09 18:42:31.641926 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi Aug 09 18:42:31.641926 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:42:31.641926 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi Aug 09 18:42:31.641926 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:42:31.641926 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:42:31.641926 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:42:31.641926 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:42:31.641926 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:42:31.641926 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 09 18:42:31.641926 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: ERROR nova.api.openstack.wsgi Aug 09 18:42:31.641926 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi [None req-e30aab8a-514d-43a7-8746-14847483f0fd admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110214) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:42:31.643178 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO nova.api.openstack.requestlog [None req-e30aab8a-514d-43a7-8746-14847483f0fd admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012617 Aug 09 18:42:31.643424 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: [pid: 110214|app: 0|req: 27/52] 10.222.0.57 () {60 vars in 1193 bytes} [Tue Aug 9 18:42:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 18:42:32.616060 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi [None req-a1d59d29-bbff-4a06-a772-a5b7f1e8b6ba admin admin] Calling method '>' {{(pid=110213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:42:32.617072 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: INFO nova.api.openstack.requestlog [None req-a1d59d29-bbff-4a06-a772-a5b7f1e8b6ba admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001946 Aug 09 18:42:32.617469 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: [pid: 110213|app: 0|req: 26/53] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Aug 9 18:42:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:42:33.140035 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi [None req-243ebe93-6d07-4084-802a-5df5c2bdc739 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:42:33.225288 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO nova.api.openstack.requestlog [None req-243ebe93-6d07-4084-802a-5df5c2bdc739 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.466318 Aug 09 18:42:33.226247 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: [pid: 110214|app: 0|req: 28/54] 10.222.0.57 () {64 vars in 1235 bytes} [Tue Aug 9 18:42:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 18:42:34.209150 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi [None req-a1d59d29-bbff-4a06-a772-a5b7f1e8b6ba admin admin] Calling method '>' {{(pid=110213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:42:34.210190 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: INFO nova.api.openstack.requestlog [None req-a1d59d29-bbff-4a06-a772-a5b7f1e8b6ba admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 09 18:42:34.210588 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: [pid: 110213|app: 0|req: 27/55] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Aug 9 18:42:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:42:34.734197 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi [None req-3fb05ea5-b5b8-468a-828d-9382c43f6a8e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:42:34.831727 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO nova.api.openstack.requestlog [None req-3fb05ea5-b5b8-468a-828d-9382c43f6a8e admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.483938 Aug 09 18:42:34.840455 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: [pid: 110214|app: 0|req: 29/56] 10.222.0.57 () {64 vars in 1235 bytes} [Tue Aug 9 18:42:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:42:35.817952 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi [None req-a1d59d29-bbff-4a06-a772-a5b7f1e8b6ba admin admin] Calling method '>' {{(pid=110213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:42:35.818995 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: INFO nova.api.openstack.requestlog [None req-a1d59d29-bbff-4a06-a772-a5b7f1e8b6ba admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Aug 09 18:42:35.819389 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: [pid: 110213|app: 0|req: 28/57] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Aug 9 18:42:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:42:36.351329 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi [None req-ff4f6aa5-34bf-4213-a462-6c6990d0bb00 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:42:36.444472 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO nova.api.openstack.requestlog [None req-ff4f6aa5-34bf-4213-a462-6c6990d0bb00 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.485437 Aug 09 18:42:36.445026 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: [pid: 110214|app: 0|req: 30/58] 10.222.0.57 () {64 vars in 1235 bytes} [Tue Aug 9 18:42:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:42:37.435346 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi [None req-a1d59d29-bbff-4a06-a772-a5b7f1e8b6ba admin admin] Calling method '>' {{(pid=110213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:42:37.436360 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: INFO nova.api.openstack.requestlog [None req-a1d59d29-bbff-4a06-a772-a5b7f1e8b6ba admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Aug 09 18:42:37.436757 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: [pid: 110213|app: 0|req: 29/59] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Aug 9 18:42:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:42:37.977719 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi [None req-ef5e9b5b-796e-447b-b6c9-0179dad4d520 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:42:38.043572 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO nova.api.openstack.requestlog [None req-ef5e9b5b-796e-447b-b6c9-0179dad4d520 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.467166 Aug 09 18:42:38.044130 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: [pid: 110214|app: 0|req: 31/60] 10.222.0.57 () {64 vars in 1235 bytes} [Tue Aug 9 18:42:37 2022] POST /compute/v2.1/flavors => generated 409 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:42:39.031163 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi [None req-a1d59d29-bbff-4a06-a772-a5b7f1e8b6ba admin admin] Calling method '>' {{(pid=110213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:42:39.032178 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: INFO nova.api.openstack.requestlog [None req-a1d59d29-bbff-4a06-a772-a5b7f1e8b6ba admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Aug 09 18:42:39.032566 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: [pid: 110213|app: 0|req: 30/61] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Aug 9 18:42:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:42:39.556262 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi [None req-4e55f44d-b2ce-4231-acf8-f55f243861b5 admin admin] Calling method '>' {{(pid=110214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:42:39.576563 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO nova.api.openstack.requestlog [None req-4e55f44d-b2ce-4231-acf8-f55f243861b5 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.406312 Aug 09 18:42:39.577104 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: [pid: 110214|app: 0|req: 32/62] 10.222.0.57 () {60 vars in 1202 bytes} [Tue Aug 9 18:42:39 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:43:31.438837 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi [None req-a1d59d29-bbff-4a06-a772-a5b7f1e8b6ba admin admin] Calling method '>' {{(pid=110213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:43:31.439839 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: INFO nova.api.openstack.requestlog [None req-a1d59d29-bbff-4a06-a772-a5b7f1e8b6ba admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Aug 09 18:43:31.440246 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: [pid: 110213|app: 0|req: 31/63] 10.222.0.57 () {54 vars in 931 bytes} [Tue Aug 9 18:43:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:43:31.450907 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG dbcounter [-] [110214] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:43:31.837868 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi [None req-e7c15226-9fa2-4c82-9ea9-4b63a37e3185 admin admin] Calling method '>' {{(pid=110214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:43:31.857887 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO nova.api.openstack.requestlog [None req-e7c15226-9fa2-4c82-9ea9-4b63a37e3185 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.411426 Aug 09 18:43:31.858430 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: [pid: 110214|app: 0|req: 33/64] 10.222.0.57 () {60 vars in 1292 bytes} [Tue Aug 9 18:43:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:43:31.881136 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG dbcounter [-] [110213] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=110213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:43:31.884883 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi [None req-9d1f4b5d-2de6-4431-b50c-282bf6f20157 admin admin] Calling method '>' {{(pid=110213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:43:31.892451 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: INFO nova.api.openstack.requestlog [None req-9d1f4b5d-2de6-4431-b50c-282bf6f20157 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012775 Aug 09 18:43:31.892972 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: [pid: 110213|app: 0|req: 32/65] 10.222.0.57 () {60 vars in 1283 bytes} [Tue Aug 9 18:43:31 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:43:31.904627 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi [None req-dfad73a7-6d4b-4902-91e3-b6766c92caea admin admin] Calling method '>' {{(pid=110214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:43:31.913012 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO nova.api.openstack.requestlog [None req-dfad73a7-6d4b-4902-91e3-b6766c92caea admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011946 Aug 09 18:43:31.913737 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: [pid: 110214|app: 0|req: 34/66] 10.222.0.57 () {60 vars in 1286 bytes} [Tue Aug 9 18:43:31 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:43:31.924890 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi [None req-993ba749-e7e7-4ad3-a8e9-047204f75b7a admin admin] Calling method '>' {{(pid=110213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:43:31.933771 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: INFO nova.api.openstack.requestlog [None req-993ba749-e7e7-4ad3-a8e9-047204f75b7a admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012344 Aug 09 18:43:31.934550 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: [pid: 110213|app: 0|req: 33/67] 10.222.0.57 () {60 vars in 1286 bytes} [Tue Aug 9 18:43:31 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:43:31.945648 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi [None req-7320de22-dd0f-494b-b616-5077e1fa33ad admin admin] Calling method '>' {{(pid=110214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:43:31.953343 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO nova.api.openstack.requestlog [None req-7320de22-dd0f-494b-b616-5077e1fa33ad admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011237 Aug 09 18:43:31.953901 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: [pid: 110214|app: 0|req: 35/68] 10.222.0.57 () {60 vars in 1283 bytes} [Tue Aug 9 18:43:31 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:46:45.247878 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi [None req-993ba749-e7e7-4ad3-a8e9-047204f75b7a admin admin] Calling method '>' {{(pid=110213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:46:45.250221 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: INFO nova.api.openstack.requestlog [None req-993ba749-e7e7-4ad3-a8e9-047204f75b7a admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 09 18:46:45.250221 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: [pid: 110213|app: 0|req: 34/69] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Aug 9 18:46:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:46:45.394485 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG dbcounter [-] [110214] Writing DB stats nova_api:SELECT=6 {{(pid=110214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:46:45.552764 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi [None req-a20743e6-08bd-4b80-b428-36293e88a1be admin admin] Calling method '>' {{(pid=110214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:46:45.555172 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 18:46:45.555172 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: warnings.warn(msg) Aug 09 18:46:45.556280 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG oslo_concurrency.lockutils [None req-a20743e6-08bd-4b80-b428-36293e88a1be admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:46:45.556789 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG oslo_concurrency.lockutils [None req-a20743e6-08bd-4b80-b428-36293e88a1be admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:46:45.557213 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG oslo_concurrency.lockutils [None req-a20743e6-08bd-4b80-b428-36293e88a1be admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:46:45.557963 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG oslo_concurrency.lockutils [None req-a20743e6-08bd-4b80-b428-36293e88a1be admin admin] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:46:45.558407 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG oslo_concurrency.lockutils [None req-a20743e6-08bd-4b80-b428-36293e88a1be admin admin] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:46:45.558823 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG oslo_concurrency.lockutils [None req-a20743e6-08bd-4b80-b428-36293e88a1be admin admin] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:46:45.594423 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO nova.api.openstack.requestlog [None req-a20743e6-08bd-4b80-b428-36293e88a1be admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.204938 Aug 09 18:46:45.594989 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: [pid: 110214|app: 0|req: 36/70] 10.222.0.57 () {60 vars in 1193 bytes} [Tue Aug 9 18:46:45 2022] GET /compute/v2.1/os-services => generated 791 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:46:46.434278 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi [None req-993ba749-e7e7-4ad3-a8e9-047204f75b7a admin admin] Calling method '>' {{(pid=110213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:46:46.435278 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: INFO nova.api.openstack.requestlog [None req-993ba749-e7e7-4ad3-a8e9-047204f75b7a admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 09 18:46:46.435670 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: [pid: 110213|app: 0|req: 35/71] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Aug 9 18:46:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:46:46.639954 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi [None req-ad738c14-662b-4cd6-b99a-9d837c65f4d4 admin admin] Calling method '>' {{(pid=110214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:46:46.642364 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 18:46:46.642364 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: warnings.warn(msg) Aug 09 18:46:46.643488 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG oslo_concurrency.lockutils [None req-ad738c14-662b-4cd6-b99a-9d837c65f4d4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:46:46.643995 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG oslo_concurrency.lockutils [None req-ad738c14-662b-4cd6-b99a-9d837c65f4d4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:46:46.644421 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG oslo_concurrency.lockutils [None req-ad738c14-662b-4cd6-b99a-9d837c65f4d4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:46:46.645131 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG oslo_concurrency.lockutils [None req-ad738c14-662b-4cd6-b99a-9d837c65f4d4 admin admin] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:46:46.645601 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG oslo_concurrency.lockutils [None req-ad738c14-662b-4cd6-b99a-9d837c65f4d4 admin admin] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:46:46.646018 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG oslo_concurrency.lockutils [None req-ad738c14-662b-4cd6-b99a-9d837c65f4d4 admin admin] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:46:46.665699 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO nova.api.openstack.requestlog [None req-ad738c14-662b-4cd6-b99a-9d837c65f4d4 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077806 Aug 09 18:46:46.666873 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: [pid: 110214|app: 0|req: 37/72] 10.222.0.57 () {60 vars in 1193 bytes} [Tue Aug 9 18:46:46 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:46:57.936671 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi [None req-993ba749-e7e7-4ad3-a8e9-047204f75b7a admin admin] Calling method '>' {{(pid=110213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:46:57.941384 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: INFO nova.api.openstack.requestlog [None req-993ba749-e7e7-4ad3-a8e9-047204f75b7a admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Aug 09 18:46:57.941384 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: [pid: 110213|app: 0|req: 36/73] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Aug 9 18:46:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:46:58.082531 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG dbcounter [-] [110214] Writing DB stats nova_cell0:SELECT=4 {{(pid=110214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:46:58.083223 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG dbcounter [-] [110214] Writing DB stats nova_cell1:SELECT=4 {{(pid=110214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:46:58.083838 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG dbcounter [-] [110214] Writing DB stats nova_api:SELECT=8 {{(pid=110214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:46:58.133439 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi [None req-9d7b25a2-50fe-4928-89df-3750067973c4 admin admin] Calling method '>' {{(pid=110214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:46:58.136487 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 18:46:58.136487 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: warnings.warn(msg) Aug 09 18:46:58.137728 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG oslo_concurrency.lockutils [None req-9d7b25a2-50fe-4928-89df-3750067973c4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:46:58.138212 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG oslo_concurrency.lockutils [None req-9d7b25a2-50fe-4928-89df-3750067973c4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:46:58.138643 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG oslo_concurrency.lockutils [None req-9d7b25a2-50fe-4928-89df-3750067973c4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:46:58.139374 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG oslo_concurrency.lockutils [None req-9d7b25a2-50fe-4928-89df-3750067973c4 admin admin] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:46:58.139823 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG oslo_concurrency.lockutils [None req-9d7b25a2-50fe-4928-89df-3750067973c4 admin admin] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:46:58.140243 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG oslo_concurrency.lockutils [None req-9d7b25a2-50fe-4928-89df-3750067973c4 admin admin] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:46:58.165886 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO nova.api.openstack.requestlog [None req-9d7b25a2-50fe-4928-89df-3750067973c4 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.087767 Aug 09 18:46:58.166457 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: [pid: 110214|app: 0|req: 38/74] 10.222.0.57 () {60 vars in 1193 bytes} [Tue Aug 9 18:46:58 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:46:59.020649 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: DEBUG nova.api.openstack.wsgi [None req-993ba749-e7e7-4ad3-a8e9-047204f75b7a admin admin] Calling method '>' {{(pid=110213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:46:59.021693 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: INFO nova.api.openstack.requestlog [None req-993ba749-e7e7-4ad3-a8e9-047204f75b7a admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Aug 09 18:46:59.022099 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: [pid: 110213|app: 0|req: 37/75] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Aug 9 18:46:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:46:59.212560 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG nova.api.openstack.wsgi [None req-d123d144-6368-4f53-ac11-569e32f64c1d admin admin] Calling method '>' {{(pid=110214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:46:59.215104 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 18:46:59.215104 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: warnings.warn(msg) Aug 09 18:46:59.216163 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG oslo_concurrency.lockutils [None req-d123d144-6368-4f53-ac11-569e32f64c1d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:46:59.216664 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG oslo_concurrency.lockutils [None req-d123d144-6368-4f53-ac11-569e32f64c1d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:46:59.217088 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG oslo_concurrency.lockutils [None req-d123d144-6368-4f53-ac11-569e32f64c1d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:46:59.217824 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG oslo_concurrency.lockutils [None req-d123d144-6368-4f53-ac11-569e32f64c1d admin admin] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:46:59.218271 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG oslo_concurrency.lockutils [None req-d123d144-6368-4f53-ac11-569e32f64c1d admin admin] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:46:59.218684 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: DEBUG oslo_concurrency.lockutils [None req-d123d144-6368-4f53-ac11-569e32f64c1d admin admin] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:46:59.240318 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: INFO nova.api.openstack.requestlog [None req-d123d144-6368-4f53-ac11-569e32f64c1d admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080880 Aug 09 18:46:59.240873 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: [pid: 110214|app: 0|req: 39/76] 10.222.0.57 () {60 vars in 1193 bytes} [Tue Aug 9 18:46:59 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:47:55.862537 dv-cinder-826608-9-iscsi devstack@n-api.service[110212]: Tue Aug 9 18:47:55 2022 - graceful shutdown triggered... Aug 09 18:47:55.863089 dv-cinder-826608-9-iscsi devstack@n-api.service[110213]: Gracefully killing worker 1 (pid: 110213)... Aug 09 18:47:55.862647 dv-cinder-826608-9-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 09 18:47:55.863921 dv-cinder-826608-9-iscsi devstack@n-api.service[110214]: Gracefully killing worker 2 (pid: 110214)... Aug 09 18:47:56.863671 dv-cinder-826608-9-iscsi devstack@n-api.service[110212]: worker 1 buried after 1 seconds Aug 09 18:47:56.863671 dv-cinder-826608-9-iscsi devstack@n-api.service[110212]: worker 2 buried after 1 seconds Aug 09 18:47:56.864352 dv-cinder-826608-9-iscsi devstack@n-api.service[110212]: goodbye to uWSGI. Aug 09 18:47:56.865847 dv-cinder-826608-9-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 09 18:47:56.866435 dv-cinder-826608-9-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 09 18:47:56.869292 dv-cinder-826608-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 09 18:47:56.878883 dv-cinder-826608-9-iscsi devstack@n-api.service[124713]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 09 18:47:56.882293 dv-cinder-826608-9-iscsi devstack@n-api.service[124713]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 9 18:47:56 2022] *** Aug 09 18:47:56.882548 dv-cinder-826608-9-iscsi devstack@n-api.service[124713]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 09 18:47:56.882747 dv-cinder-826608-9-iscsi devstack@n-api.service[124713]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 09 18:47:56.882877 dv-cinder-826608-9-iscsi devstack@n-api.service[124713]: nodename: dv-cinder-826608-9-iscsi Aug 09 18:47:56.883007 dv-cinder-826608-9-iscsi devstack@n-api.service[124713]: machine: x86_64 Aug 09 18:47:56.883007 dv-cinder-826608-9-iscsi devstack@n-api.service[124713]: clock source: unix Aug 09 18:47:56.883007 dv-cinder-826608-9-iscsi devstack@n-api.service[124713]: pcre jit disabled Aug 09 18:47:56.883007 dv-cinder-826608-9-iscsi devstack@n-api.service[124713]: detected number of CPU cores: 4 Aug 09 18:47:56.883007 dv-cinder-826608-9-iscsi devstack@n-api.service[124713]: current working directory: / Aug 09 18:47:56.883007 dv-cinder-826608-9-iscsi devstack@n-api.service[124713]: detected binary path: /usr/bin/uwsgi-core Aug 09 18:47:56.883007 dv-cinder-826608-9-iscsi devstack@n-api.service[124713]: your processes number limit is 47680 Aug 09 18:47:56.883007 dv-cinder-826608-9-iscsi devstack@n-api.service[124713]: your memory page size is 4096 bytes Aug 09 18:47:56.883007 dv-cinder-826608-9-iscsi devstack@n-api.service[124713]: detected max file descriptor number: 2048 Aug 09 18:47:56.883608 dv-cinder-826608-9-iscsi devstack@n-api.service[124713]: lock engine: pthread robust mutexes Aug 09 18:47:56.883608 dv-cinder-826608-9-iscsi devstack@n-api.service[124713]: thunder lock: enabled Aug 09 18:47:56.883608 dv-cinder-826608-9-iscsi devstack@n-api.service[124713]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 09 18:47:56.883608 dv-cinder-826608-9-iscsi devstack@n-api.service[124713]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 09 18:47:56.922638 dv-cinder-826608-9-iscsi devstack@n-api.service[124713]: Python main interpreter initialized at 0x56396859c9c0 Aug 09 18:47:56.922638 dv-cinder-826608-9-iscsi devstack@n-api.service[124713]: python threads support enabled Aug 09 18:47:56.922638 dv-cinder-826608-9-iscsi devstack@n-api.service[124713]: your server socket listen backlog is limited to 100 connections Aug 09 18:47:56.922638 dv-cinder-826608-9-iscsi devstack@n-api.service[124713]: your mercy for graceful operations on workers is 90 seconds Aug 09 18:47:56.923091 dv-cinder-826608-9-iscsi devstack@n-api.service[124713]: mapped 403077 bytes (393 KB) for 2 cores Aug 09 18:47:56.923091 dv-cinder-826608-9-iscsi devstack@n-api.service[124713]: *** Operational MODE: preforking *** Aug 09 18:47:56.923353 dv-cinder-826608-9-iscsi devstack@n-api.service[124713]: *** uWSGI is running in multiple interpreter mode *** Aug 09 18:47:56.923353 dv-cinder-826608-9-iscsi devstack@n-api.service[124713]: spawned uWSGI master process (pid: 124713) Aug 09 18:47:56.923569 dv-cinder-826608-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 09 18:47:56.924135 dv-cinder-826608-9-iscsi devstack@n-api.service[124713]: spawned uWSGI worker 1 (pid: 124725, cores: 1) Aug 09 18:47:56.925149 dv-cinder-826608-9-iscsi devstack@n-api.service[124713]: spawned uWSGI worker 2 (pid: 124726, cores: 1) Aug 09 18:47:56.925149 dv-cinder-826608-9-iscsi devstack@n-api.service[124713]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 09 18:47:57.627914 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 18:47:57.665546 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 18:47:58.803477 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 18:47:58.803477 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: from cryptography.utils import int_from_bytes Aug 09 18:47:58.804084 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 18:47:58.804084 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: from cryptography.utils import int_from_bytes Aug 09 18:47:58.831087 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 18:47:58.831087 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: from cryptography.utils import int_from_bytes Aug 09 18:47:58.831662 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 18:47:58.831662 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: from cryptography.utils import int_from_bytes Aug 09 18:48:01.157612 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 18:48:01.158291 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 18:48:01.158387 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 18:48:01.158688 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 18:48:01.158946 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 18:48:01.159332 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.159657 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.159979 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.160297 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.160623 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.160934 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.161251 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.162113 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.162440 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.162706 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.163012 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.163562 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826608-9-iscsi {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.163897 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.164209 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.164520 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.164840 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.165147 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.165469 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.165802 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.166313 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.166755 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.167062 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.167392 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.167711 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.168023 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.168331 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.168654 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.169091 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.169279 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.169715 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.170014 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826608-9-iscsi {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.170328 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.170639 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.170953 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.171369 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.171680 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.172007 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.172321 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.172644 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.172929 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 18:48:01.173362 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.173454 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 18:48:01.173561 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.173640 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.173752 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 18:48:01.173907 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.174126 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 18:48:01.174223 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.174387 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 18:48:01.174514 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.174786 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.174925 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.175115 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.175220 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.175431 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.175526 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.175737 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.176098 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.176300 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.176445 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.176585 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.176684 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.176867 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.177645 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.177734 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.177849 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.178049 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.178184 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.178373 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.178479 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.178662 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.178806 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.178896 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.179071 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826608-9-iscsi {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.179177 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.179399 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.179495 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.181984 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.182116 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.182207 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.182314 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.182411 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.182504 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.182620 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.182757 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.182757 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.182949 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.183045 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.183132 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.183215 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.183304 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.183414 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.183508 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.183593 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.183685 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.183995 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.184149 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.184318 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.184485 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.184649 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.184803 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.184955 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.185110 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.185272 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.185429 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.185562 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.185665 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.185764 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.185859 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.185953 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.186045 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.186138 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.186231 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826608-9-iscsi {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.186323 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.186397 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.186468 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.186549 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.186622 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.186699 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.186782 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.186782 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.186939 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.187023 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.187105 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.187254 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.187386 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.187528 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.187619 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.188580 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.188684 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.188776 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.188851 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.188929 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.189012 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.189085 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.189162 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.189251 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.189346 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.189447 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.189546 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.189635 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.189743 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.189842 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.190069 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.190176 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.191502 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.191676 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.191829 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.191964 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.192084 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.192223 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.192322 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.192408 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.192516 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.192516 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.192516 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.194688 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.194826 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.194982 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.195113 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.195113 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.195113 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.195113 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.195113 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.196112 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.196245 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.196379 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.196379 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.196379 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.196885 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.196885 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.197163 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.197335 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.199029 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.199215 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.199382 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.199541 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.199692 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.199692 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.199692 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.199692 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.200401 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.200401 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.200401 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.200837 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.201051 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.205791 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.205791 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.205791 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.205791 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.205791 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.205791 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.205791 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.205791 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.206402 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.206402 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.206402 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.206402 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.206402 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.206402 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.206402 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.206402 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.206920 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.207024 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.207106 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.207185 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.207264 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.207342 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.207429 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.207617 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.207714 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.207965 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.208072 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.208346 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.208445 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.208664 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.208768 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.208926 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.209027 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.209245 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.209356 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.209604 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.209721 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.209922 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.210032 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.210235 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.210345 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.210552 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.210684 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.210871 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.211055 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.211165 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.211405 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.211532 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.211755 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.211871 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.212086 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.212209 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.212402 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.212508 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.212720 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.212829 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.213039 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.213156 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.213361 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.213501 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.213696 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.214015 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.214131 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.214348 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.214522 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.214833 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.215070 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.215220 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.215443 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.215554 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.215875 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.215978 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.216166 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.216323 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.216677 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.216964 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.217102 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.217318 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.217665 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.217942 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.218058 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.218315 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.218656 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.218836 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.218979 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.219306 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.219613 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.219726 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.219939 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.220263 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.220522 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.220634 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.220917 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.221238 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.221360 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.221802 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.222026 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.222160 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.222486 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.222795 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.222908 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.223135 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.223454 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.224284 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.224399 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.224925 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.225032 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.225570 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.225754 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.226275 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.226379 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.226649 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.226980 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.227263 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.227375 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.227613 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.227931 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.228250 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.228450 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.228551 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.228903 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.229215 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.229603 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.229729 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.229906 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.230016 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.230231 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.230561 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.230673 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.230889 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.231005 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.231215 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.231315 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.231555 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.231656 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.231869 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.232218 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.232511 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.232616 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.232779 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.232902 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.233097 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.233206 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.233412 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.233543 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:48:01.233878 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.234161 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.234715 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.234885 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.235086 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.235421 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.235595 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.235801 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.236106 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.236337 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.236432 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.236514 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.236754 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.236868 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.237083 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.237182 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.237416 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.237649 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.237846 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.238095 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.238322 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.238440 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.238743 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.238996 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.239122 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.239323 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.239506 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.240312 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.240437 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.240638 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.240760 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.240983 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.241118 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.241293 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.241413 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.241650 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.244889 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.244889 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.245331 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.246005 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.246166 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.246327 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.246490 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.246644 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.246793 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.246946 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.247146 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.247306 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.247472 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.247627 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.247774 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.247928 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.248075 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.248271 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.248434 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.248588 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.248742 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.248889 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.249043 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.249215 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.249369 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.249515 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.249695 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.249852 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.250005 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.250165 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.250312 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.250463 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.250609 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.250754 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.250907 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.251147 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.251336 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.251490 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.251635 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.251797 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.251945 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.252104 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.252250 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.252590 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.252792 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.253043 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.253289 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.253651 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.253833 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.254008 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.254240 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.254402 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.254560 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.254706 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.254859 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.255036 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.255190 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.255451 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.255617 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.255771 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.255920 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.256075 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.256221 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.256365 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.256603 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.256754 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.256899 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.257044 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.257199 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.257354 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.257501 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.257667 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.257824 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.257970 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.258133 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.258290 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.272256 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.273240 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.273408 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.273706 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.273880 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.274035 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.274185 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.274332 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.274479 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.274634 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.274863 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.275009 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.275154 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.275950 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.276089 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.276226 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.276768 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.276902 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.277018 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.277132 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.277244 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.277365 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.277486 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.283588 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.283776 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.283927 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.284154 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.284154 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.284501 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.284652 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.284847 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.285034 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.285184 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.285361 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.285716 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.285871 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.286075 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.286227 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.287202 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.287376 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.287526 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.287673 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.287819 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.287986 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.288147 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.288306 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.288452 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.288606 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.288808 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.288968 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.289162 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.289314 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.289468 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.289653 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.289801 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.289958 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.290145 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.290295 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.290441 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.290593 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.290740 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.290902 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.291062 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.291209 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.291362 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.292125 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.292386 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.292546 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.292703 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.292852 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.292997 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.293290 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.293451 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.293633 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.293802 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.293959 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.294106 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.294375 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.294522 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.294678 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.294870 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.295066 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.295225 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.295447 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.295596 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.295940 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.296094 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.296252 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.296397 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.296541 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.296701 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.296848 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.296993 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.297156 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.297652 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.297652 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.298026 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.298182 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.298363 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.298523 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.298669 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.298813 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.298973 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.299130 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.299285 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.299431 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.299576 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.299576 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.299859 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.300005 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.300156 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.300311 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.300468 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.300622 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.300768 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.301176 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.301334 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.301536 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.301536 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.301837 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.302023 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.302301 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.302541 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.302691 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.302845 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.303016 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.303171 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.303440 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.304403 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.304561 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.304709 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.304948 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.305104 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.305251 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.305397 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.305600 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.305753 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.306107 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.306284 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.306483 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.306642 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.306796 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.307029 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.307179 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.307634 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.307801 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.307961 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.308116 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.308276 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.308423 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.308570 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.308728 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.308882 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.309028 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.309188 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.309452 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.309637 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.309798 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.309945 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.310091 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.310251 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.312963 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.316184 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.316369 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.316369 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.316713 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.316874 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.317035 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.317191 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.317831 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.318013 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.318747 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.318909 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.319061 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.319220 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.319375 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.319536 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.322321 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.323193 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.323375 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.323534 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.323698 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.323698 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.324004 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.324197 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.324197 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.324481 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.324669 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.324918 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.325129 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.325321 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.325474 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.325687 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.325984 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.326137 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.326291 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.326446 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.326599 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.326744 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.326899 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.327075 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.328101 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.328293 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.328601 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.328748 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.328901 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.329047 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.329331 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.335113 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.335113 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.335460 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.335604 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.335745 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.335922 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.336183 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.336343 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.336905 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.337079 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.337232 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.337413 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.337684 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.337838 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.338251 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.338416 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.338620 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.338805 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.338955 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.339147 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.339308 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.339463 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.339609 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.339769 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.339934 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.340202 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.340354 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.340500 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.340656 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.340829 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.341068 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.341229 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.341384 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.341557 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.341722 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.341880 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.342060 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.342219 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.342367 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.342521 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.342698 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.342927 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.343662 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.343843 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.344099 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.344297 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.344455 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.344612 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.344759 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.344905 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.345067 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.345340 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.345495 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.345709 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.345856 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.346013 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.346221 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.346474 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.346635 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.346789 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.346943 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.347097 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.347097 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.347396 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.347543 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.347714 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.347929 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.347929 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.348405 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.348569 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.348717 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.349429 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.349612 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.349772 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.349932 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.350080 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.350352 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.350506 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.350661 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.350809 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.351009 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.351259 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.351411 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.351558 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.351704 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.351848 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.352008 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.352164 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.352318 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.352505 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.352505 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.352809 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.353046 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.353207 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.353391 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.354014 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.354312 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.354312 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.354312 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.354312 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.354873 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.355028 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.355028 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.355028 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.355028 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.355028 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.355028 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.356016 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.356171 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.356324 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.356599 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.356599 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.356599 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.356599 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.356599 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.357307 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.357452 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.357632 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.357867 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.358119 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.358401 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.358633 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.358633 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.358916 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.359071 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.359226 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.359379 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.359541 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.359694 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.359847 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.360014 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.360169 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.360341 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.360508 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.360662 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.360814 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.360998 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.361258 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.361488 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.361488 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.361488 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.361966 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.362121 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.362273 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.362433 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.362433 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.362763 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.362763 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.363082 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.363312 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.363477 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.363477 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.363776 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.363776 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.364094 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.364094 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.364557 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.364738 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.364902 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.365057 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.365225 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.365405 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.365728 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.365728 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.366105 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.366262 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.366459 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.366636 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.366884 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.366884 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.367207 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.367371 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.367371 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.367669 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.367669 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.367969 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.368155 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.368396 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.368635 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.368866 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.369024 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.369177 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.369339 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.369512 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.369691 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.369845 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.370012 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.370180 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.370341 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.370496 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.370647 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.370800 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.370952 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.371113 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.371290 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.371615 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.371796 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.371957 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.372110 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.372279 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.372432 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.372689 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.372861 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.373023 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.373177 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.373355 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.373610 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.373774 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.373941 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.374106 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.374267 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.374534 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.374707 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.374870 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.375032 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.375194 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.375362 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.375523 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.375800 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.375962 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.376122 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.376295 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.376461 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.376775 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.377060 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.377228 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.377383 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.377554 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.377726 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.377883 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.378043 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.378197 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.378378 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.378676 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.378997 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.379159 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.379320 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.379473 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.379473 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.379793 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.379956 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.380148 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.380304 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.380467 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.380620 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.380857 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.381020 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.381194 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.381349 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.381501 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.381932 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.382102 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.382264 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.382433 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.382433 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.382780 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.382780 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.383090 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.383244 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.383396 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.383585 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.383826 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.383994 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.384150 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.384304 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.384465 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.384643 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.384882 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.385051 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.385214 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.385368 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.385368 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.385704 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.386554 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.386721 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.386900 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.386900 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.387798 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.387954 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.388119 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.388282 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.388282 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.388607 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.388894 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.389222 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.389408 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.389592 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.389760 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.389760 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.390059 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.390222 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.390385 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.390538 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.390698 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.390860 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.391013 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.391166 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.391327 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.391492 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.391856 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.392029 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.392182 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.392350 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.392507 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.392776 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.392944 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.393107 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.393259 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.393425 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.393652 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.393828 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.394087 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.394247 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.394399 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.394567 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.394722 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.394892 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.395129 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.395287 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.395448 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.396181 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.396350 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.396597 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.396758 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.396924 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.397086 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.397255 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.397410 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.397580 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.397580 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.397980 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.398151 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.398305 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.398467 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.398666 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.398851 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.399083 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.399399 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.399558 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.399711 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.399874 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.400035 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.400195 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.400359 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.400513 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.400673 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.400829 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.400980 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.401236 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.401407 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.401659 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.401827 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.402066 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.402224 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.402392 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.402553 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.402707 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.402965 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.403851 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.404067 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.404324 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.404497 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.404652 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.404652 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.404976 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.404976 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.404976 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.404976 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.404976 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.405854 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.406009 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.406174 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.406387 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.406583 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.406821 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.406987 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.407142 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.407302 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.407465 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.407627 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.407781 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.408058 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.408219 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.408374 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.408541 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.408716 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.408876 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.409161 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.409613 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.409726 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.409835 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.409932 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.410020 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.410112 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.410200 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.410296 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.410384 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.410469 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.410561 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.410647 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.410732 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.410824 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.410918 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.411011 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.411097 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.411181 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.411319 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.411427 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.411523 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.411616 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.411703 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.411794 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.411886 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.411981 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.412084 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.412178 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.412264 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.412357 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.412452 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.412545 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.412637 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.412723 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.412814 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.412908 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.413222 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.413316 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.413403 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.413487 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.413606 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.413693 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.413693 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.413866 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.413953 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.414045 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.414137 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.414221 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.414330 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.414425 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.414512 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.414605 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.414710 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.414811 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.414811 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.414967 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.415059 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.415151 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.415237 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.415331 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.415446 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.415540 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.415627 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.415712 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.415798 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.415895 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.415990 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.416083 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.416170 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.416262 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.416375 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.416478 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.416573 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.416660 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.416745 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.416846 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.416940 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.417035 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.417128 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.417221 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.417315 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.417401 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.417493 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.417604 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.417706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.417796 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.417879 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.417879 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.418176 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.418283 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.418371 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.418455 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.418547 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.418642 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.418806 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.418902 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.418902 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.419064 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.419158 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.419276 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.419372 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.419465 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.419570 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.419665 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.419752 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.419849 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.419849 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.420019 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.420105 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.420197 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.420282 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.420375 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.420375 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.420537 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.420623 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.420707 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.420810 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.420905 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.421017 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.421111 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.421204 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.421289 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.421382 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.421475 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.421579 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.421666 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.421763 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.421850 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.421944 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.422037 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.422124 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.422215 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.422301 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.422385 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.422479 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.422573 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.422658 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.422742 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.422826 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.422918 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.423011 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.423127 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.423235 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.423329 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.423421 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.423515 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.423602 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.423602 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.423754 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.423863 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.423951 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.424045 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.424138 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.424224 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.424308 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.424399 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.424498 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.424586 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.424670 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.424775 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.424869 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.424955 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.425049 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.425135 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.425225 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.425318 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.425404 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.425487 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.425654 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.425750 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.426096 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.426096 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.426268 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.426268 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.426437 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.426523 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.426614 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.426700 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.426784 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.427394 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.427499 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.427585 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.427671 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.427765 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.427851 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.427851 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.428027 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.428113 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.428216 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.428216 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.428390 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.428485 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.428572 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.428572 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.428738 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.428830 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.428929 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.429016 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.429100 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.429190 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.429275 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.429275 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.429448 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.429615 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.429716 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.429799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.429893 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.429980 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.430078 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.430164 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.430164 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.430318 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.430428 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.430524 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.430610 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.430700 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.430786 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.430868 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.430952 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.431048 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.431143 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.431230 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.431321 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.431416 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.431514 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.431607 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.431699 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.431791 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.431885 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.431979 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.432077 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.432164 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.432164 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.432305 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.432377 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.432468 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.432571 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.432658 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.432749 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.432835 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.432927 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.433012 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.433105 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.433190 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.433283 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.433369 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.433466 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.433597 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.433687 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.433771 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.433872 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.433956 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.434048 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.434143 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.434230 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.434313 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.434406 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.434493 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.434577 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.434669 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.434757 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.434848 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.434939 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.434939 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.435092 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.435185 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.435271 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.435362 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.435448 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.435532 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.435624 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.435706 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.435778 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.435860 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.435944 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.436030 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.436178 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.436255 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.436255 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.436422 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.436422 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.436583 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.436679 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.436766 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.436857 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.436950 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.437043 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.437127 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.437219 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.437320 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.437320 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.437475 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.437475 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.437662 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.437746 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.437839 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.437925 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.438019 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.438105 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.438202 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.438288 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.438379 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.438472 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.438557 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.438648 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.438648 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.438818 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.438904 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.438987 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.439083 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.439169 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.439262 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.439355 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.439439 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.439522 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.439612 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.439706 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.439793 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.439873 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.439952 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.440043 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.440134 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.440237 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.440322 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.440406 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.440489 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.440579 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.440676 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.440757 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.440850 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.440934 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.441025 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.441123 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.441123 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.441298 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.441298 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.441451 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.441451 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.441630 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.442357 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.442459 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.442598 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.442702 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.443296 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.443380 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.443468 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.443549 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.443631 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.443706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.443706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.443843 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.443936 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.444011 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.444082 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.444160 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.444246 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.444328 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.444407 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.444480 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.444559 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.444631 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.444702 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.444791 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.444872 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.444952 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.445033 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.445113 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.445193 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.445278 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.445358 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.445437 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.445512 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.445691 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.445779 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.445854 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.445927 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.446006 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.446006 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.446006 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.446217 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.446290 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.446368 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.446368 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.446512 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.446585 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.446666 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.446740 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.446810 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.446896 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.446984 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.447082 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.447177 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.447177 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.447333 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.447424 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.447517 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.447605 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.447605 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.447605 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.447605 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.447605 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.447931 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.448026 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.448107 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.448187 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.448379 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.448524 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.448855 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.449193 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.449543 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.449662 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.449927 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.450029 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.450240 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.450344 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.450569 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.450664 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.450903 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.450997 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.451231 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.451327 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.451547 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.451640 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.451862 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.451952 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.452179 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.452288 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.452525 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.452628 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.452832 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.452933 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.453146 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.453329 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.453493 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.453674 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.453834 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.454036 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.454199 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.454465 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.454623 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.454779 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.454926 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.455086 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.455241 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.455429 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.455607 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.455758 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.455913 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.456068 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.456215 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.456373 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.456538 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.456694 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.456855 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.457002 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.457147 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.457292 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.457447 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.457723 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.458041 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.458241 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.458392 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.458548 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.458708 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.458854 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.459014 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.459170 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.459332 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.459479 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.459638 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.459880 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.460060 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.460213 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.460359 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.460504 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.460659 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.460830 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.460978 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.461131 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.461285 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.461438 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.461615 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.461782 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.461931 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.462086 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.462241 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.462388 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.462533 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.462703 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.462859 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.463013 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.463168 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.463322 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.463478 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.463632 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.463794 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.463942 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.464095 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.464241 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.464408 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.464667 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.464822 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.464976 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.465131 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.465277 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.465432 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.465609 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.465762 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.465910 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.466070 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.466226 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.466379 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.466535 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.466700 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.466847 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.467003 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.467166 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.467321 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.467469 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.467615 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.467760 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.467914 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.468071 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.468218 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.468218 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.468512 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.468659 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.468812 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.468967 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.469115 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.469268 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.469414 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.469609 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.469864 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.470028 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.470177 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.470324 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.470477 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.470634 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.470791 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.470939 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.471098 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.471254 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.471400 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.471554 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.471713 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.471868 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.472022 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.472171 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.472861 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 18:48:01.473063 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.473063 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.473063 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.473063 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.473675 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.473675 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.474008 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.474239 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.474571 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.474901 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.475222 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.475566 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.475886 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.476209 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.476532 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.476872 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.477174 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.477496 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.477868 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.478204 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.478522 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.478860 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.479191 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.479523 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.479987 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.480194 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.481019 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.481019 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.481324 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.481481 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.481863 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.482185 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.482510 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.482829 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.483147 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.483474 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.483799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.484136 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.484471 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.484790 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.485133 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.485444 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.485837 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.486162 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.486517 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.486863 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.487192 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.487597 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.487828 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:48:01.488077 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 18:48:01.632822 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO dbcounter [None req-ef715632-cdd4-4e57-80d5-9e6a892b90f5 None None] Registered counter for database nova_api Aug 09 18:48:01.640596 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO dbcounter [None req-16409b4a-60d3-4bdf-80bd-9e679afe8397 None None] Registered counter for database nova_api Aug 09 18:48:01.653780 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_db.sqlalchemy.engines [None req-ef715632-cdd4-4e57-80d5-9e6a892b90f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 18:48:01.660089 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_db.sqlalchemy.engines [None req-16409b4a-60d3-4bdf-80bd-9e679afe8397 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 18:48:01.660427 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writer thread running {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 18:48:01.667284 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writer thread running {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 18:48:01.717455 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.context [None req-ef715632-cdd4-4e57-80d5-9e6a892b90f5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9980bb26-9539-4867-bcdf-a8100feea5e1(cell1) {{(pid=124726) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 18:48:01.721927 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ef715632-cdd4-4e57-80d5-9e6a892b90f5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:48:01.722398 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ef715632-cdd4-4e57-80d5-9e6a892b90f5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:48:01.723718 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.context [None req-16409b4a-60d3-4bdf-80bd-9e679afe8397 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9980bb26-9539-4867-bcdf-a8100feea5e1(cell1) {{(pid=124725) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 18:48:01.724470 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ef715632-cdd4-4e57-80d5-9e6a892b90f5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:48:01.725205 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ef715632-cdd4-4e57-80d5-9e6a892b90f5 None None] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:48:01.725678 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ef715632-cdd4-4e57-80d5-9e6a892b90f5 None None] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:48:01.727991 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ef715632-cdd4-4e57-80d5-9e6a892b90f5 None None] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:48:01.728313 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-16409b4a-60d3-4bdf-80bd-9e679afe8397 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:48:01.728792 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-16409b4a-60d3-4bdf-80bd-9e679afe8397 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:48:01.730158 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO dbcounter [None req-ef715632-cdd4-4e57-80d5-9e6a892b90f5 None None] Registered counter for database nova_cell0 Aug 09 18:48:01.730388 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-16409b4a-60d3-4bdf-80bd-9e679afe8397 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:48:01.731133 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-16409b4a-60d3-4bdf-80bd-9e679afe8397 None None] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:48:01.731587 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-16409b4a-60d3-4bdf-80bd-9e679afe8397 None None] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:48:01.733595 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-16409b4a-60d3-4bdf-80bd-9e679afe8397 None None] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:48:01.734295 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO dbcounter [None req-ef715632-cdd4-4e57-80d5-9e6a892b90f5 None None] Registered counter for database nova_cell1 Aug 09 18:48:01.735584 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO dbcounter [None req-16409b4a-60d3-4bdf-80bd-9e679afe8397 None None] Registered counter for database nova_cell0 Aug 09 18:48:01.740263 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO dbcounter [None req-16409b4a-60d3-4bdf-80bd-9e679afe8397 None None] Registered counter for database nova_cell1 Aug 09 18:48:01.742216 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_db.sqlalchemy.engines [None req-ef715632-cdd4-4e57-80d5-9e6a892b90f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 18:48:01.746860 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_db.sqlalchemy.engines [None req-ef715632-cdd4-4e57-80d5-9e6a892b90f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 18:48:01.747639 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_db.sqlalchemy.engines [None req-16409b4a-60d3-4bdf-80bd-9e679afe8397 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 18:48:01.751764 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writer thread running {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 18:48:01.751928 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_db.sqlalchemy.engines [None req-16409b4a-60d3-4bdf-80bd-9e679afe8397 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 18:48:01.753054 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writer thread running {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 18:48:01.753359 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writer thread running {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 18:48:01.897345 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writer thread running {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 18:48:01.903107 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO dbcounter [None req-ef715632-cdd4-4e57-80d5-9e6a892b90f5 None None] Registered counter for database nova_cell0 Aug 09 18:48:01.906537 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO dbcounter [None req-16409b4a-60d3-4bdf-80bd-9e679afe8397 None None] Registered counter for database nova_cell0 Aug 09 18:48:01.913480 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_db.sqlalchemy.engines [None req-ef715632-cdd4-4e57-80d5-9e6a892b90f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 18:48:01.915038 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_db.sqlalchemy.engines [None req-16409b4a-60d3-4bdf-80bd-9e679afe8397 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 18:48:01.918480 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writer thread running {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 18:48:01.919985 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writer thread running {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 18:48:02.239637 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: WARNING keystonemiddleware.auth_token [None req-ef715632-cdd4-4e57-80d5-9e6a892b90f5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 18:48:02.248097 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: WARNING keystonemiddleware.auth_token [None req-ef715632-cdd4-4e57-80d5-9e6a892b90f5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 18:48:02.249060 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: WARNING keystonemiddleware.auth_token [None req-16409b4a-60d3-4bdf-80bd-9e679afe8397 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 18:48:02.256546 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: WARNING keystonemiddleware.auth_token [None req-16409b4a-60d3-4bdf-80bd-9e679afe8397 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 18:48:02.599500 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: WARNING keystonemiddleware.auth_token [None req-ef715632-cdd4-4e57-80d5-9e6a892b90f5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 18:48:02.605637 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: WARNING keystonemiddleware.auth_token [None req-ef715632-cdd4-4e57-80d5-9e6a892b90f5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 18:48:02.608852 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: WARNING keystonemiddleware.auth_token [None req-16409b4a-60d3-4bdf-80bd-9e679afe8397 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 18:48:02.612485 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56396859c9c0 pid: 124726 (default app) Aug 09 18:48:02.615004 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: WARNING keystonemiddleware.auth_token [None req-16409b4a-60d3-4bdf-80bd-9e679afe8397 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 18:48:02.621788 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56396859c9c0 pid: 124725 (default app) Aug 09 18:48:44.397366 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-d66060c7-de7e-4b2f-a8dd-cf41694bae18 tempest-VolumesTestJSON-1654605727 tempest-VolumesTestJSON-1654605727-project] Calling method '.version_select at 0x7f8d6bdde940>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:48:44.426157 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_api:SELECT=3 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:48:44.427461 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell0:SELECT=3 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:48:44.428635 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell1:SELECT=3 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:48:44.429830 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell0:SELECT=3 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:48:44.884914 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-d66060c7-de7e-4b2f-a8dd-cf41694bae18 tempest-VolumesTestJSON-1654605727 tempest-VolumesTestJSON-1654605727-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/26cf46fc-33d3-4716-b8aa-43182ef20fc1" status: 200 len: 351 microversion: 2.1 time: 0.788486 Aug 09 18:48:44.885999 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 1/1] 10.222.0.57 () {58 vars in 1245 bytes} [Tue Aug 9 18:48:44 2022] GET /compute/v2.1/os-volumes/26cf46fc-33d3-4716-b8aa-43182ef20fc1 => generated 351 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:48:47.458502 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=3 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:48:47.464291 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=3 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:48:47.465443 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=3 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:48:47.479297 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=3 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:48:47.898816 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e0edaab0-373d-47b1-87b1-33842c516c0f tempest-VolumesTestJSON-1654605727 tempest-VolumesTestJSON-1654605727-project] Calling method '.version_select at 0x7f8d6bd798b0>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:48:48.692466 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e0edaab0-373d-47b1-87b1-33842c516c0f tempest-VolumesTestJSON-1654605727 tempest-VolumesTestJSON-1654605727-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/40d6d2d9-7117-435a-be1e-b9454128f05f" status: 200 len: 350 microversion: 2.1 time: 1.253347 Aug 09 18:48:48.696101 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 1/2] 10.222.0.57 () {58 vars in 1245 bytes} [Tue Aug 9 18:48:47 2022] GET /compute/v2.1/os-volumes/40d6d2d9-7117-435a-be1e-b9454128f05f => generated 350 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:48:50.820037 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-f7a95b40-24e3-4fb8-a4d3-33e9249cfce2 tempest-VolumesTestJSON-1654605727 tempest-VolumesTestJSON-1654605727-project] Calling method '.version_select at 0x7f8d6bc33dc0>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:48:50.934083 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-f7a95b40-24e3-4fb8-a4d3-33e9249cfce2 tempest-VolumesTestJSON-1654605727 tempest-VolumesTestJSON-1654605727-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/4f63a586-d689-4ea9-ab3e-86ed03674615" status: 200 len: 351 microversion: 2.1 time: 0.122019 Aug 09 18:48:50.935193 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 2/3] 10.222.0.57 () {58 vars in 1245 bytes} [Tue Aug 9 18:48:50 2022] GET /compute/v2.1/os-volumes/4f63a586-d689-4ea9-ab3e-86ed03674615 => generated 351 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:48:50.951196 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5a1ab24c-3a99-43a7-bdbd-572dc05a8ec9 tempest-VolumesTestJSON-1654605727 tempest-VolumesTestJSON-1654605727-project] Calling method '.version_select at 0x7f8d6bbc1820>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:48:51.168305 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-5a1ab24c-3a99-43a7-bdbd-572dc05a8ec9 tempest-VolumesTestJSON-1654605727 tempest-VolumesTestJSON-1654605727-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.223440 Aug 09 18:48:51.170829 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 2/4] 10.222.0.57 () {58 vars in 1134 bytes} [Tue Aug 9 18:48:50 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:48:51.185078 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-28c48f8d-018c-49ba-9232-fd389f91ff28 tempest-VolumesTestJSON-1654605727 tempest-VolumesTestJSON-1654605727-project] Calling method '.version_select at 0x7f8d6bc33af0>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:48:51.374328 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-28c48f8d-018c-49ba-9232-fd389f91ff28 tempest-VolumesTestJSON-1654605727 tempest-VolumesTestJSON-1654605727-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.193355 Aug 09 18:48:51.375428 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 3/5] 10.222.0.57 () {58 vars in 1149 bytes} [Tue Aug 9 18:48:51 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:48:51.392250 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-cd3e9119-0eb1-4f4e-a830-5bbb9e67a35f tempest-VolumesTestJSON-1654605727 tempest-VolumesTestJSON-1654605727-project] Calling method '.version_select at 0x7f8d6c50c0d0>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:48:51.565515 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-cd3e9119-0eb1-4f4e-a830-5bbb9e67a35f tempest-VolumesTestJSON-1654605727 tempest-VolumesTestJSON-1654605727-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.179284 Aug 09 18:48:51.566964 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 4/6] 10.222.0.57 () {58 vars in 1134 bytes} [Tue Aug 9 18:48:51 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:48:51.579483 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-bc28e4f8-2049-4c59-b301-aeec6e6bb3f3 tempest-VolumesTestJSON-1654605727 tempest-VolumesTestJSON-1654605727-project] Calling method '.version_select at 0x7f8d6bbe6ee0>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:48:51.686714 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-bc28e4f8-2049-4c59-b301-aeec6e6bb3f3 tempest-VolumesTestJSON-1654605727 tempest-VolumesTestJSON-1654605727-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.111056 Aug 09 18:48:51.696018 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 5/7] 10.222.0.57 () {58 vars in 1167 bytes} [Tue Aug 9 18:48:51 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:48:51.701896 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-38ab88c0-bc59-4c7b-b51c-9aacbc55b909 tempest-VolumesTestJSON-1654605727 tempest-VolumesTestJSON-1654605727-project] Calling method '.version_select at 0x7f8d6bb9f160>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:48:51.837273 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-38ab88c0-bc59-4c7b-b51c-9aacbc55b909 tempest-VolumesTestJSON-1654605727 tempest-VolumesTestJSON-1654605727-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.139906 Aug 09 18:48:51.839085 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 6/8] 10.222.0.57 () {58 vars in 1170 bytes} [Tue Aug 9 18:48:51 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:48:51.857432 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-82dac8d4-f263-480a-b83f-015a86aaa4bb tempest-VolumesTestJSON-1654605727 tempest-VolumesTestJSON-1654605727-project] Calling method '.version_select at 0x7f8d6bbe6f70>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:48:51.888686 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-1e074f05-da53-49fe-bb38-5085c91bc563 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Action: 'create', calling method: .version_select at 0x7f8d6bbc1ee0>, body: {"keypair": {"name": "tempest-keypair-2062690512", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcrOPO+/zPlFZK4gwWbig5gr0/p4aGd1GtAbL68yuo+zL84kFV7GJfJxi1qBNYNKQiEp5toUI3GyJoQSso6IEYYHxDlFn9WvtPtTIbXaTqyWO7fGju3Sv/nl863wn2mpA=="}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:48:52.006176 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-1e074f05-da53-49fe-bb38-5085c91bc563 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Getting quotas for project 4d8f60ca836d43399989fb32ad78d27d. Resources: {'key_pairs'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:48:52.019208 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-1e074f05-da53-49fe-bb38-5085c91bc563 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Getting quotas for user a6e48ee30c61424ba0c82ac4fc5cd06c and project 4d8f60ca836d43399989fb32ad78d27d. Resources: {'key_pairs'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:48:52.041455 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-82dac8d4-f263-480a-b83f-015a86aaa4bb tempest-VolumesTestJSON-1654605727 tempest-VolumesTestJSON-1654605727-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.190333 Aug 09 18:48:52.049917 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 7/9] 10.222.0.57 () {58 vars in 1155 bytes} [Tue Aug 9 18:48:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:48:52.065963 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-49a99f16-91f3-47f1-9a33-9bbea28be2d7 tempest-VolumesTestJSON-1654605727 tempest-VolumesTestJSON-1654605727-project] Calling method '.version_select at 0x7f8d6c50c160>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:48:52.206031 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-1e074f05-da53-49fe-bb38-5085c91bc563 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.928137 Aug 09 18:48:52.206655 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 3/10] 10.222.0.57 () {60 vars in 1159 bytes} [Tue Aug 9 18:48:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:48:52.270509 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-49a99f16-91f3-47f1-9a33-9bbea28be2d7 tempest-VolumesTestJSON-1654605727 tempest-VolumesTestJSON-1654605727-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.218917 Aug 09 18:48:52.271206 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 8/11] 10.222.0.57 () {58 vars in 1188 bytes} [Tue Aug 9 18:48:52 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:48:52.285362 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-26178ed0-685c-455c-8c0a-4e7d0ee68c51 tempest-VolumesTestJSON-1654605727 tempest-VolumesTestJSON-1654605727-project] Calling method '.version_select at 0x7f8d6bb6e940>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:48:52.566738 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-26178ed0-685c-455c-8c0a-4e7d0ee68c51 tempest-VolumesTestJSON-1654605727 tempest-VolumesTestJSON-1654605727-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.285605 Aug 09 18:48:52.567770 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 4/12] 10.222.0.57 () {58 vars in 1155 bytes} [Tue Aug 9 18:48:52 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:48:55.778183 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-43876640-fe2a-4a35-8b60-6cdf5570bd3f tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-509792823", "imageRef": "124dd477-ccfa-4be3-9973-6b1f33b47df8", "flavorRef": "452", "networks": [{"uuid": "ff922386-0de5-4cfa-9682-3ac7d1465dcb"}]}} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:48:56.043079 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.network.neutron [None req-43876640-fe2a-4a35-8b60-6cdf5570bd3f tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] validate_networks() for [('ff922386-0de5-4cfa-9682-3ac7d1465dcb', None, None, None, None, None)] {{(pid=124726) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:48:57.972909 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.virt.hardware [None req-43876640-fe2a-4a35-8b60-6cdf5570bd3f tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Flavor limits 0:0:0 {{(pid=124726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:48:57.976184 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.virt.hardware [None req-43876640-fe2a-4a35-8b60-6cdf5570bd3f tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Image limits 0:0:0 {{(pid=124726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:48:57.978460 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.virt.hardware [None req-43876640-fe2a-4a35-8b60-6cdf5570bd3f tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Flavor pref 0:0:0 {{(pid=124726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:48:57.979730 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.virt.hardware [None req-43876640-fe2a-4a35-8b60-6cdf5570bd3f tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Image pref 0:0:0 {{(pid=124726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:48:57.981022 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.virt.hardware [None req-43876640-fe2a-4a35-8b60-6cdf5570bd3f tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:48:58.007513 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-43876640-fe2a-4a35-8b60-6cdf5570bd3f tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:48:58.008415 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-43876640-fe2a-4a35-8b60-6cdf5570bd3f tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:48:58.009783 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-43876640-fe2a-4a35-8b60-6cdf5570bd3f tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:48:58.012185 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-43876640-fe2a-4a35-8b60-6cdf5570bd3f tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:48:58.013404 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-43876640-fe2a-4a35-8b60-6cdf5570bd3f tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:48:58.017121 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-43876640-fe2a-4a35-8b60-6cdf5570bd3f tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:48:58.075608 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.quota [None req-43876640-fe2a-4a35-8b60-6cdf5570bd3f tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Getting quotas for project 539b956efa1b47799514fbdcac7e250c. Resources: {'cores', 'ram', 'instances'} {{(pid=124726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:48:58.097180 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.quota [None req-43876640-fe2a-4a35-8b60-6cdf5570bd3f tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Getting quotas for user 7fde48fb289b4c7591658e27ce5ff55e and project 539b956efa1b47799514fbdcac7e250c. Resources: {'cores', 'ram', 'instances'} {{(pid=124726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:48:58.149789 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-43876640-fe2a-4a35-8b60-6cdf5570bd3f tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Going to run 1 instances... {{(pid=124726) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:48:58.155766 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-43876640-fe2a-4a35-8b60-6cdf5570bd3f tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] [instance: 5471fc9e-e776-43fb-b11d-a617257a4a29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='124dd477-ccfa-4be3-9973-6b1f33b47df8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:48:58.250320 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-374016be-a5c7-4348-8a47-2ca6f65d137e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Action: 'create', calling method: .version_select at 0x7f8d6b32a1f0>, body: {"keypair": {"name": "tempest-keypair-1491812523", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ9nAxPlcttglI/lqxNFWf09u3DSzlpEDx8XWW7EdbZPUPit3uKL75ZwdivvI2ewRxr77n4wha2FMhi1ACCubsnPMjUHwClN4/Q8tOlzhBZOg7rOYHr4Q3HXjTPniPONxQ=="}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:48:58.290855 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-374016be-a5c7-4348-8a47-2ca6f65d137e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Getting quotas for project 6d738e0a61184b4db58e2607d72cca0a. Resources: {'key_pairs'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:48:58.302854 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-374016be-a5c7-4348-8a47-2ca6f65d137e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Getting quotas for user ef8af9fd9e844ca4be10caa880357a4f and project 6d738e0a61184b4db58e2607d72cca0a. Resources: {'key_pairs'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:48:58.498432 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-43876640-fe2a-4a35-8b60-6cdf5570bd3f tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.975445 Aug 09 18:48:58.505263 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 9/13] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 9 18:48:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2983 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:48:58.513239 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-374016be-a5c7-4348-8a47-2ca6f65d137e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.121560 Aug 09 18:48:58.514010 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 5/14] 10.222.0.57 () {62 vars in 1200 bytes} [Tue Aug 9 18:48:57 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1123 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 09 18:48:58.517946 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-c09f91c9-74ba-4dc6-a61b-8503defd77d0 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:48:58.518592 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-c09f91c9-74ba-4dc6-a61b-8503defd77d0 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] [instance: 5471fc9e-e776-43fb-b11d-a617257a4a29] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:48:58.871506 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-c09f91c9-74ba-4dc6-a61b-8503defd77d0 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde48fb289b4c7591658e27ce5ff55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539b956efa1b47799514fbdcac7e250c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:48:58.910220 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-c09f91c9-74ba-4dc6-a61b-8503defd77d0 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] 10.222.0.57 "GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29" status: 200 len: 1214 microversion: 2.1 time: 0.396775 Aug 09 18:48:58.914927 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 10/15] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:48:58 2022] GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29 => generated 1214 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:48:59.938995 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b0e6dbd6-f103-43ce-b11b-9a82e6fce78b tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:48:59.939746 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-b0e6dbd6-f103-43ce-b11b-9a82e6fce78b tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] [instance: 5471fc9e-e776-43fb-b11d-a617257a4a29] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:00.266918 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-b0e6dbd6-f103-43ce-b11b-9a82e6fce78b tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde48fb289b4c7591658e27ce5ff55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539b956efa1b47799514fbdcac7e250c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:00.296542 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-b0e6dbd6-f103-43ce-b11b-9a82e6fce78b tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] 10.222.0.57 "GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29" status: 200 len: 1214 microversion: 2.1 time: 0.361297 Aug 09 18:49:00.320125 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 6/16] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:48:59 2022] GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29 => generated 1214 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:01.320591 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-877716ab-5e08-4d79-b33e-32535029933e tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:01.321206 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-877716ab-5e08-4d79-b33e-32535029933e tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] [instance: 5471fc9e-e776-43fb-b11d-a617257a4a29] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:01.364803 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-57fc111d-8887-40bd-9252-0ce44b62ce2f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2005912427", "imageRef": "124dd477-ccfa-4be3-9973-6b1f33b47df8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:49:01.492433 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.network.neutron [None req-57fc111d-8887-40bd-9252-0ce44b62ce2f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] validate_networks() for [('2ec0f66c-7c91-4571-a05d-131085748c82', None, None, None, None, None)] {{(pid=124726) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:49:01.573200 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-877716ab-5e08-4d79-b33e-32535029933e tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde48fb289b4c7591658e27ce5ff55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539b956efa1b47799514fbdcac7e250c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:01.582657 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-877716ab-5e08-4d79-b33e-32535029933e tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] 10.222.0.57 "GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29" status: 200 len: 1214 microversion: 2.1 time: 0.266123 Aug 09 18:49:01.598421 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 7/17] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:01 2022] GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29 => generated 1214 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:49:01.611550 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-93968f22-88d8-4fbb-89e4-3032c1b610f1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1277567104", "imageRef": "124dd477-ccfa-4be3-9973-6b1f33b47df8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e7858aa7-cff3-45e7-8595-598238cb5ae7"}], "security_groups": [{"name": "tempest-securitygroup--406009547"}], "key_name": "tempest-keypair-2062690512", "user_data": "}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:49:01.870105 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.network.neutron [None req-93968f22-88d8-4fbb-89e4-3032c1b610f1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] validate_networks() for [('e7858aa7-cff3-45e7-8595-598238cb5ae7', None, None, None, None, None)] {{(pid=124725) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:49:02.818572 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.virt.hardware [None req-57fc111d-8887-40bd-9252-0ce44b62ce2f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Flavor limits 0:0:0 {{(pid=124726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:49:02.819271 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.virt.hardware [None req-57fc111d-8887-40bd-9252-0ce44b62ce2f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Image limits 0:0:0 {{(pid=124726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:49:02.819921 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.virt.hardware [None req-57fc111d-8887-40bd-9252-0ce44b62ce2f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Flavor pref 0:0:0 {{(pid=124726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:49:02.820483 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.virt.hardware [None req-57fc111d-8887-40bd-9252-0ce44b62ce2f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Image pref 0:0:0 {{(pid=124726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:49:02.821068 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.virt.hardware [None req-57fc111d-8887-40bd-9252-0ce44b62ce2f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:49:02.834945 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-57fc111d-8887-40bd-9252-0ce44b62ce2f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:02.834945 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-57fc111d-8887-40bd-9252-0ce44b62ce2f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:02.834945 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-57fc111d-8887-40bd-9252-0ce44b62ce2f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:02.835610 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-57fc111d-8887-40bd-9252-0ce44b62ce2f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:02.836232 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-57fc111d-8887-40bd-9252-0ce44b62ce2f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:02.836814 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-57fc111d-8887-40bd-9252-0ce44b62ce2f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:02.887235 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.quota [None req-57fc111d-8887-40bd-9252-0ce44b62ce2f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Getting quotas for project d3c7915d78334e95a41a32f0f3b5b084. Resources: {'cores', 'ram', 'instances'} {{(pid=124726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:49:02.898368 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.quota [None req-57fc111d-8887-40bd-9252-0ce44b62ce2f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Getting quotas for user 04da0f4276d6457c889ecb3006842e9c and project d3c7915d78334e95a41a32f0f3b5b084. Resources: {'cores', 'ram', 'instances'} {{(pid=124726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:49:02.931708 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-57fc111d-8887-40bd-9252-0ce44b62ce2f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Going to run 1 instances... {{(pid=124726) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:49:02.934924 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-57fc111d-8887-40bd-9252-0ce44b62ce2f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='124dd477-ccfa-4be3-9973-6b1f33b47df8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:49:03.147421 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-57fc111d-8887-40bd-9252-0ce44b62ce2f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.061163 Aug 09 18:49:03.148664 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 11/18] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 9 18:49:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 2063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:49:03.155037 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-b61da991-a17c-491f-b1b6-beb9fe4dd089 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:03.156335 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-b61da991-a17c-491f-b1b6-beb9fe4dd089 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] [instance: 5471fc9e-e776-43fb-b11d-a617257a4a29] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:03.165382 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b61da991-a17c-491f-b1b6-beb9fe4dd089 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:03.166854 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b61da991-a17c-491f-b1b6-beb9fe4dd089 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:03.167474 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b61da991-a17c-491f-b1b6-beb9fe4dd089 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:03.169821 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b61da991-a17c-491f-b1b6-beb9fe4dd089 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:03.170552 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b61da991-a17c-491f-b1b6-beb9fe4dd089 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:03.171251 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b61da991-a17c-491f-b1b6-beb9fe4dd089 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:03.548449 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-93968f22-88d8-4fbb-89e4-3032c1b610f1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Flavor limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:49:03.553632 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-93968f22-88d8-4fbb-89e4-3032c1b610f1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Image limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:49:03.554332 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-93968f22-88d8-4fbb-89e4-3032c1b610f1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Flavor pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:49:03.555689 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-93968f22-88d8-4fbb-89e4-3032c1b610f1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Image pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:49:03.558339 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-93968f22-88d8-4fbb-89e4-3032c1b610f1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:49:03.573330 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-93968f22-88d8-4fbb-89e4-3032c1b610f1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:03.574632 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-93968f22-88d8-4fbb-89e4-3032c1b610f1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:03.576625 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-93968f22-88d8-4fbb-89e4-3032c1b610f1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:03.588214 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-93968f22-88d8-4fbb-89e4-3032c1b610f1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:03.588927 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-93968f22-88d8-4fbb-89e4-3032c1b610f1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:03.589700 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-93968f22-88d8-4fbb-89e4-3032c1b610f1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:03.672287 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-93968f22-88d8-4fbb-89e4-3032c1b610f1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Getting quotas for project 4d8f60ca836d43399989fb32ad78d27d. Resources: {'cores', 'ram', 'instances'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:49:03.686989 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-93968f22-88d8-4fbb-89e4-3032c1b610f1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Getting quotas for user a6e48ee30c61424ba0c82ac4fc5cd06c and project 4d8f60ca836d43399989fb32ad78d27d. Resources: {'cores', 'ram', 'instances'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:49:03.726054 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-93968f22-88d8-4fbb-89e4-3032c1b610f1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Going to run 1 instances... {{(pid=124725) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:49:03.730396 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-93968f22-88d8-4fbb-89e4-3032c1b610f1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='124dd477-ccfa-4be3-9973-6b1f33b47df8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:49:03.808321 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-b61da991-a17c-491f-b1b6-beb9fe4dd089 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde48fb289b4c7591658e27ce5ff55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539b956efa1b47799514fbdcac7e250c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:03.825828 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-b61da991-a17c-491f-b1b6-beb9fe4dd089 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] 10.222.0.57 "GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29" status: 200 len: 1266 microversion: 2.1 time: 0.675228 Aug 09 18:49:03.865651 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 12/19] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:03 2022] GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29 => generated 1266 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:03.880500 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-24e13889-0f82-4603-93ab-46885b5fd702 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:03.881418 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-24e13889-0f82-4603-93ab-46885b5fd702 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:03.932495 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-93968f22-88d8-4fbb-89e4-3032c1b610f1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.332220 Aug 09 18:49:03.933826 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 8/20] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 9 18:49:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 2334 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:49:04.000672 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d1bedfae-a8ba-41ea-9049-da3678447734 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:04.001726 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-d1bedfae-a8ba-41ea-9049-da3678447734 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:04.074489 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-24e13889-0f82-4603-93ab-46885b5fd702 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:04.082703 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-24e13889-0f82-4603-93ab-46885b5fd702 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1222 microversion: 2.1 time: 0.215398 Aug 09 18:49:04.086989 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 13/21] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:03 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1222 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:04.183784 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d1bedfae-a8ba-41ea-9049-da3678447734 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:04.192323 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-d1bedfae-a8ba-41ea-9049-da3678447734 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1238 microversion: 2.1 time: 0.251154 Aug 09 18:49:04.210632 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 9/22] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:03 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1238 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:04.327942 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-3367a47c-ec30-4536-8757-0fd105b34c2f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1574236153", "imageRef": "124dd477-ccfa-4be3-9973-6b1f33b47df8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:49:04.471517 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.network.neutron [None req-3367a47c-ec30-4536-8757-0fd105b34c2f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] validate_networks() for [('2ec0f66c-7c91-4571-a05d-131085748c82', None, None, None, None, None)] {{(pid=124726) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:49:04.867593 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-3474b898-8088-4032-b9cd-45117671992d tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:04.868684 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-3474b898-8088-4032-b9cd-45117671992d tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] [instance: 5471fc9e-e776-43fb-b11d-a617257a4a29] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:04.882240 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3474b898-8088-4032-b9cd-45117671992d tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:04.882753 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3474b898-8088-4032-b9cd-45117671992d tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:04.883432 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3474b898-8088-4032-b9cd-45117671992d tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:04.884451 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3474b898-8088-4032-b9cd-45117671992d tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:04.886699 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3474b898-8088-4032-b9cd-45117671992d tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:04.887542 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3474b898-8088-4032-b9cd-45117671992d tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:05.267045 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-3474b898-8088-4032-b9cd-45117671992d tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde48fb289b4c7591658e27ce5ff55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539b956efa1b47799514fbdcac7e250c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:05.293920 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-3474b898-8088-4032-b9cd-45117671992d tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] 10.222.0.57 "GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29" status: 200 len: 1274 microversion: 2.1 time: 0.434044 Aug 09 18:49:05.295394 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 10/23] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:04 2022] GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29 => generated 1274 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:49:05.308276 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-662cdd20-5438-4ccf-947e-d1536b03a8d9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-5223650", "imageRef": "124dd477-ccfa-4be3-9973-6b1f33b47df8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7320bb6e-9e62-43d8-9234-a6a50410e80e"}], "security_groups": [{"name": "tempest-securitygroup--1393273825"}], "key_name": "tempest-keypair-1491812523", "user_data": "}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:49:05.518504 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.virt.hardware [None req-3367a47c-ec30-4536-8757-0fd105b34c2f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Flavor limits 0:0:0 {{(pid=124726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:49:05.520028 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.virt.hardware [None req-3367a47c-ec30-4536-8757-0fd105b34c2f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Image limits 0:0:0 {{(pid=124726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:49:05.520663 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.virt.hardware [None req-3367a47c-ec30-4536-8757-0fd105b34c2f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Flavor pref 0:0:0 {{(pid=124726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:49:05.521365 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.virt.hardware [None req-3367a47c-ec30-4536-8757-0fd105b34c2f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Image pref 0:0:0 {{(pid=124726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:49:05.522061 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.virt.hardware [None req-3367a47c-ec30-4536-8757-0fd105b34c2f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:49:05.534384 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3367a47c-ec30-4536-8757-0fd105b34c2f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:05.535105 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3367a47c-ec30-4536-8757-0fd105b34c2f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:05.535690 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3367a47c-ec30-4536-8757-0fd105b34c2f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:05.536579 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3367a47c-ec30-4536-8757-0fd105b34c2f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:05.537355 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3367a47c-ec30-4536-8757-0fd105b34c2f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:05.538044 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3367a47c-ec30-4536-8757-0fd105b34c2f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:05.584305 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.quota [None req-3367a47c-ec30-4536-8757-0fd105b34c2f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Getting quotas for project d3c7915d78334e95a41a32f0f3b5b084. Resources: {'cores', 'ram', 'instances'} {{(pid=124726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:49:05.597111 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.quota [None req-3367a47c-ec30-4536-8757-0fd105b34c2f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Getting quotas for user 04da0f4276d6457c889ecb3006842e9c and project d3c7915d78334e95a41a32f0f3b5b084. Resources: {'cores', 'ram', 'instances'} {{(pid=124726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:49:05.629321 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.network.neutron [None req-662cdd20-5438-4ccf-947e-d1536b03a8d9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] validate_networks() for [('7320bb6e-9e62-43d8-9234-a6a50410e80e', None, None, None, None, None)] {{(pid=124725) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:49:05.644261 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-3367a47c-ec30-4536-8757-0fd105b34c2f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Going to run 1 instances... {{(pid=124726) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:49:05.646464 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-3367a47c-ec30-4536-8757-0fd105b34c2f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='124dd477-ccfa-4be3-9973-6b1f33b47df8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:49:05.857889 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-3367a47c-ec30-4536-8757-0fd105b34c2f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.534119 Aug 09 18:49:05.865255 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 14/24] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 9 18:49:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 1542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:49:05.885510 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-c32bcae5-8cae-497b-8b10-b86b70ecaac0 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:05.886500 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-c32bcae5-8cae-497b-8b10-b86b70ecaac0 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:05.896783 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c32bcae5-8cae-497b-8b10-b86b70ecaac0 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:05.897635 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c32bcae5-8cae-497b-8b10-b86b70ecaac0 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:05.898217 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c32bcae5-8cae-497b-8b10-b86b70ecaac0 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:05.899261 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c32bcae5-8cae-497b-8b10-b86b70ecaac0 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:05.900378 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c32bcae5-8cae-497b-8b10-b86b70ecaac0 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:05.900965 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c32bcae5-8cae-497b-8b10-b86b70ecaac0 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:05.998366 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-c32bcae5-8cae-497b-8b10-b86b70ecaac0 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:06.008821 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-c32bcae5-8cae-497b-8b10-b86b70ecaac0 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1242 microversion: 2.1 time: 0.142122 Aug 09 18:49:06.009435 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 15/25] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:05 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1242 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:06.028915 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-81c30481-2146-4bc9-be07-2e55f566dd67 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:06.029562 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-81c30481-2146-4bc9-be07-2e55f566dd67 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:06.115670 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-81c30481-2146-4bc9-be07-2e55f566dd67 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:06.124442 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-81c30481-2146-4bc9-be07-2e55f566dd67 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1222 microversion: 2.1 time: 0.113907 Aug 09 18:49:06.126680 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 16/26] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:06 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1222 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:06.275778 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-662cdd20-5438-4ccf-947e-d1536b03a8d9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Flavor limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:49:06.276343 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-662cdd20-5438-4ccf-947e-d1536b03a8d9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Image limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:49:06.277012 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-662cdd20-5438-4ccf-947e-d1536b03a8d9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Flavor pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:49:06.277547 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-662cdd20-5438-4ccf-947e-d1536b03a8d9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Image pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:49:06.278239 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-662cdd20-5438-4ccf-947e-d1536b03a8d9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:49:06.288517 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-662cdd20-5438-4ccf-947e-d1536b03a8d9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:06.289098 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-662cdd20-5438-4ccf-947e-d1536b03a8d9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:06.289650 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-662cdd20-5438-4ccf-947e-d1536b03a8d9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:06.290488 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-662cdd20-5438-4ccf-947e-d1536b03a8d9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:06.291129 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-662cdd20-5438-4ccf-947e-d1536b03a8d9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:06.291641 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-662cdd20-5438-4ccf-947e-d1536b03a8d9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:06.309806 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-662cdd20-5438-4ccf-947e-d1536b03a8d9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Getting quotas for project 6d738e0a61184b4db58e2607d72cca0a. Resources: {'cores', 'ram', 'instances'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:49:06.314439 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-662cdd20-5438-4ccf-947e-d1536b03a8d9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Getting quotas for user ef8af9fd9e844ca4be10caa880357a4f and project 6d738e0a61184b4db58e2607d72cca0a. Resources: {'cores', 'ram', 'instances'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:49:06.316945 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-122ef807-c743-4c7e-a92c-2bb6ca7f6d47 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:06.317818 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-122ef807-c743-4c7e-a92c-2bb6ca7f6d47 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] [instance: 5471fc9e-e776-43fb-b11d-a617257a4a29] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:06.325444 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-122ef807-c743-4c7e-a92c-2bb6ca7f6d47 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:06.326155 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-122ef807-c743-4c7e-a92c-2bb6ca7f6d47 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:06.326630 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-662cdd20-5438-4ccf-947e-d1536b03a8d9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Going to run 1 instances... {{(pid=124725) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:49:06.326783 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-122ef807-c743-4c7e-a92c-2bb6ca7f6d47 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:06.327494 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-122ef807-c743-4c7e-a92c-2bb6ca7f6d47 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:06.328013 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-122ef807-c743-4c7e-a92c-2bb6ca7f6d47 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:06.328438 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-122ef807-c743-4c7e-a92c-2bb6ca7f6d47 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:06.329327 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-662cdd20-5438-4ccf-947e-d1536b03a8d9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='124dd477-ccfa-4be3-9973-6b1f33b47df8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:49:06.406082 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-122ef807-c743-4c7e-a92c-2bb6ca7f6d47 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde48fb289b4c7591658e27ce5ff55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539b956efa1b47799514fbdcac7e250c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:06.419116 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-122ef807-c743-4c7e-a92c-2bb6ca7f6d47 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] 10.222.0.57 "GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29" status: 200 len: 1274 microversion: 2.1 time: 0.106518 Aug 09 18:49:06.420019 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 17/27] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:06 2022] GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29 => generated 1274 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:49:06.577798 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-662cdd20-5438-4ccf-947e-d1536b03a8d9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.280948 Aug 09 18:49:06.581891 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 11/28] 10.222.0.57 () {62 vars in 1188 bytes} [Tue Aug 9 18:49:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 1286 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 09 18:49:06.594085 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-d4bb6a71-d34c-4d47-b02c-04b5c34585a5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:06.594799 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-d4bb6a71-d34c-4d47-b02c-04b5c34585a5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:06.751041 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-d4bb6a71-d34c-4d47-b02c-04b5c34585a5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:06.756068 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-d4bb6a71-d34c-4d47-b02c-04b5c34585a5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:06.757957 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-d4bb6a71-d34c-4d47-b02c-04b5c34585a5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:06.759268 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-d4bb6a71-d34c-4d47-b02c-04b5c34585a5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1279 microversion: 2.20 time: 0.170015 Aug 09 18:49:06.764653 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 18/29] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:49:06 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1279 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:49:07.037965 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-86901f4d-7685-4a4e-be03-68a0be335069 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:07.038660 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-86901f4d-7685-4a4e-be03-68a0be335069 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:07.053565 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-86901f4d-7685-4a4e-be03-68a0be335069 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:07.059051 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-86901f4d-7685-4a4e-be03-68a0be335069 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:07.060425 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-86901f4d-7685-4a4e-be03-68a0be335069 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:07.063824 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-86901f4d-7685-4a4e-be03-68a0be335069 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:07.067552 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-86901f4d-7685-4a4e-be03-68a0be335069 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:07.068359 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-86901f4d-7685-4a4e-be03-68a0be335069 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:07.155686 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-1e851415-48e9-4558-9754-b2a9b9e51360 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:07.156738 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-1e851415-48e9-4558-9754-b2a9b9e51360 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:07.167973 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-86901f4d-7685-4a4e-be03-68a0be335069 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:07.178317 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-86901f4d-7685-4a4e-be03-68a0be335069 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1234 microversion: 2.1 time: 0.143885 Aug 09 18:49:07.189577 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 12/30] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:07 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1234 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:07.203713 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1e851415-48e9-4558-9754-b2a9b9e51360 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:07.209153 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1e851415-48e9-4558-9754-b2a9b9e51360 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:07.212286 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1e851415-48e9-4558-9754-b2a9b9e51360 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:07.213214 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1e851415-48e9-4558-9754-b2a9b9e51360 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:07.215018 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1e851415-48e9-4558-9754-b2a9b9e51360 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:07.215473 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1e851415-48e9-4558-9754-b2a9b9e51360 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:07.336730 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-1e851415-48e9-4558-9754-b2a9b9e51360 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:07.349044 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-1e851415-48e9-4558-9754-b2a9b9e51360 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1226 microversion: 2.1 time: 0.200346 Aug 09 18:49:07.350235 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 19/31] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:07 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1226 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:49:07.443806 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d67894d8-dad3-4d33-a8c9-9f8d76467073 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:07.444604 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-d67894d8-dad3-4d33-a8c9-9f8d76467073 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] [instance: 5471fc9e-e776-43fb-b11d-a617257a4a29] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:07.466116 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d67894d8-dad3-4d33-a8c9-9f8d76467073 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:07.468005 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d67894d8-dad3-4d33-a8c9-9f8d76467073 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:07.469959 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d67894d8-dad3-4d33-a8c9-9f8d76467073 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:07.471696 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d67894d8-dad3-4d33-a8c9-9f8d76467073 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:07.473590 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d67894d8-dad3-4d33-a8c9-9f8d76467073 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:07.475344 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d67894d8-dad3-4d33-a8c9-9f8d76467073 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:07.792106 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-7aa95990-8b8b-4d27-b168-0aef8464a59e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:07.793465 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-7aa95990-8b8b-4d27-b168-0aef8464a59e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:08.031435 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-7aa95990-8b8b-4d27-b168-0aef8464a59e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:08.040636 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-7aa95990-8b8b-4d27-b168-0aef8464a59e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:08.042206 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-7aa95990-8b8b-4d27-b168-0aef8464a59e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:08.050869 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-7aa95990-8b8b-4d27-b168-0aef8464a59e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1279 microversion: 2.20 time: 0.263255 Aug 09 18:49:08.051651 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 20/32] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:49:07 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1279 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:49:08.179073 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d67894d8-dad3-4d33-a8c9-9f8d76467073 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde48fb289b4c7591658e27ce5ff55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539b956efa1b47799514fbdcac7e250c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:08.202545 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-cc29103a-3d93-4167-83cf-54d2392225e6 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:08.202643 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-d67894d8-dad3-4d33-a8c9-9f8d76467073 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] 10.222.0.57 "GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29" status: 200 len: 1272 microversion: 2.1 time: 0.764435 Aug 09 18:49:08.202749 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-cc29103a-3d93-4167-83cf-54d2392225e6 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:08.205495 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 13/33] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:07 2022] GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29 => generated 1272 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:08.263504 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cc29103a-3d93-4167-83cf-54d2392225e6 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:08.274965 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cc29103a-3d93-4167-83cf-54d2392225e6 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:08.284054 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cc29103a-3d93-4167-83cf-54d2392225e6 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:08.284850 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cc29103a-3d93-4167-83cf-54d2392225e6 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:08.285336 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cc29103a-3d93-4167-83cf-54d2392225e6 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:08.290099 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cc29103a-3d93-4167-83cf-54d2392225e6 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:08.371122 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f0866fe3-ed72-4afb-aa44-0b64ef74a61f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:08.372410 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-f0866fe3-ed72-4afb-aa44-0b64ef74a61f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:08.384049 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f0866fe3-ed72-4afb-aa44-0b64ef74a61f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:08.384543 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f0866fe3-ed72-4afb-aa44-0b64ef74a61f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:08.384978 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f0866fe3-ed72-4afb-aa44-0b64ef74a61f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:08.389856 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f0866fe3-ed72-4afb-aa44-0b64ef74a61f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:08.390470 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f0866fe3-ed72-4afb-aa44-0b64ef74a61f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:08.393407 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f0866fe3-ed72-4afb-aa44-0b64ef74a61f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:08.530303 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-cc29103a-3d93-4167-83cf-54d2392225e6 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:08.546600 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-cc29103a-3d93-4167-83cf-54d2392225e6 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1290 microversion: 2.1 time: 0.350095 Aug 09 18:49:08.547833 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 21/34] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:08 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1290 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:08.608602 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f0866fe3-ed72-4afb-aa44-0b64ef74a61f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:08.625775 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f0866fe3-ed72-4afb-aa44-0b64ef74a61f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1274 microversion: 2.1 time: 0.259244 Aug 09 18:49:08.627529 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 14/35] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:08 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1274 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:09.076710 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-4f09553a-9fd5-401d-91b3-9d07ccad2088 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:09.078414 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-4f09553a-9fd5-401d-91b3-9d07ccad2088 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:09.112516 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4f09553a-9fd5-401d-91b3-9d07ccad2088 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:09.112516 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4f09553a-9fd5-401d-91b3-9d07ccad2088 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:09.112516 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4f09553a-9fd5-401d-91b3-9d07ccad2088 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:09.112516 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4f09553a-9fd5-401d-91b3-9d07ccad2088 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:09.112809 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4f09553a-9fd5-401d-91b3-9d07ccad2088 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:09.134869 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4f09553a-9fd5-401d-91b3-9d07ccad2088 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:09.229051 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d78a2b58-f74e-47c5-8db1-3c0d6485a87a tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:09.229719 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-d78a2b58-f74e-47c5-8db1-3c0d6485a87a tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] [instance: 5471fc9e-e776-43fb-b11d-a617257a4a29] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:09.237619 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d78a2b58-f74e-47c5-8db1-3c0d6485a87a tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:09.238107 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d78a2b58-f74e-47c5-8db1-3c0d6485a87a tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:09.248925 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d78a2b58-f74e-47c5-8db1-3c0d6485a87a tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:09.253039 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d78a2b58-f74e-47c5-8db1-3c0d6485a87a tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:09.253660 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d78a2b58-f74e-47c5-8db1-3c0d6485a87a tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:09.254094 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d78a2b58-f74e-47c5-8db1-3c0d6485a87a tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:09.636998 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-4f09553a-9fd5-401d-91b3-9d07ccad2088 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:09.678394 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-4f09553a-9fd5-401d-91b3-9d07ccad2088 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:09.693357 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-4f09553a-9fd5-401d-91b3-9d07ccad2088 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:09.725735 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-4f09553a-9fd5-401d-91b3-9d07ccad2088 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1283 microversion: 2.20 time: 0.636894 Aug 09 18:49:09.728087 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 22/36] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:49:09 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1283 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:49:09.750674 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-01c6673a-c08d-4c71-9fb4-4e01564b60c9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:09.760276 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-01c6673a-c08d-4c71-9fb4-4e01564b60c9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:09.789603 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-01c6673a-c08d-4c71-9fb4-4e01564b60c9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:09.797927 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d78a2b58-f74e-47c5-8db1-3c0d6485a87a tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde48fb289b4c7591658e27ce5ff55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539b956efa1b47799514fbdcac7e250c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:09.799329 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-01c6673a-c08d-4c71-9fb4-4e01564b60c9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:09.801216 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-01c6673a-c08d-4c71-9fb4-4e01564b60c9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:09.804039 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-01c6673a-c08d-4c71-9fb4-4e01564b60c9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:09.808415 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-d78a2b58-f74e-47c5-8db1-3c0d6485a87a tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] 10.222.0.57 "GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29" status: 200 len: 1314 microversion: 2.1 time: 0.583371 Aug 09 18:49:09.808591 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-01c6673a-c08d-4c71-9fb4-4e01564b60c9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:09.810409 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 15/37] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:09 2022] GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29 => generated 1314 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:09.811636 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-01c6673a-c08d-4c71-9fb4-4e01564b60c9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:09.816896 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f533ac55-3aae-40b7-aae6-06f100814e8b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:09.830266 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-f533ac55-3aae-40b7-aae6-06f100814e8b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:09.837346 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f533ac55-3aae-40b7-aae6-06f100814e8b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:09.838963 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f533ac55-3aae-40b7-aae6-06f100814e8b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:09.842411 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f533ac55-3aae-40b7-aae6-06f100814e8b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:09.843432 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f533ac55-3aae-40b7-aae6-06f100814e8b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:09.846242 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f533ac55-3aae-40b7-aae6-06f100814e8b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:09.846929 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f533ac55-3aae-40b7-aae6-06f100814e8b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:10.001929 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f533ac55-3aae-40b7-aae6-06f100814e8b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:10.010880 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f533ac55-3aae-40b7-aae6-06f100814e8b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1282 microversion: 2.1 time: 0.198014 Aug 09 18:49:10.012159 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 16/38] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:09 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1282 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:10.380417 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-01c6673a-c08d-4c71-9fb4-4e01564b60c9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:10.413831 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-01c6673a-c08d-4c71-9fb4-4e01564b60c9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1296 microversion: 2.1 time: 0.684276 Aug 09 18:49:10.420810 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 23/39] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:09 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1296 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:10.765049 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-1b5f07b3-ee4d-4f1b-a50c-9b9b8cab9903 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:10.765049 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-1b5f07b3-ee4d-4f1b-a50c-9b9b8cab9903 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:10.765049 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1b5f07b3-ee4d-4f1b-a50c-9b9b8cab9903 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:10.765049 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1b5f07b3-ee4d-4f1b-a50c-9b9b8cab9903 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:10.766477 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1b5f07b3-ee4d-4f1b-a50c-9b9b8cab9903 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:10.766477 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1b5f07b3-ee4d-4f1b-a50c-9b9b8cab9903 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:10.766477 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1b5f07b3-ee4d-4f1b-a50c-9b9b8cab9903 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:10.766477 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1b5f07b3-ee4d-4f1b-a50c-9b9b8cab9903 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:10.904759 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-712724e4-b113-47b9-8153-9986818d1ff3 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:10.904759 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-712724e4-b113-47b9-8153-9986818d1ff3 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] [instance: 5471fc9e-e776-43fb-b11d-a617257a4a29] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:10.904759 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-712724e4-b113-47b9-8153-9986818d1ff3 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:10.904759 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-712724e4-b113-47b9-8153-9986818d1ff3 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:10.905441 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-712724e4-b113-47b9-8153-9986818d1ff3 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:10.905441 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-712724e4-b113-47b9-8153-9986818d1ff3 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:10.905441 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-712724e4-b113-47b9-8153-9986818d1ff3 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:10.905441 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-712724e4-b113-47b9-8153-9986818d1ff3 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:10.905814 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1b5f07b3-ee4d-4f1b-a50c-9b9b8cab9903 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:10.905814 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1b5f07b3-ee4d-4f1b-a50c-9b9b8cab9903 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:10.906487 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1b5f07b3-ee4d-4f1b-a50c-9b9b8cab9903 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:10.906487 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-1b5f07b3-ee4d-4f1b-a50c-9b9b8cab9903 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1331 microversion: 2.20 time: 0.132760 Aug 09 18:49:10.906487 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 17/40] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:49:10 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1331 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:49:11.040568 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-4093e6d2-8e3c-46fe-9a5b-a936025cdd82 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:11.041510 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-4093e6d2-8e3c-46fe-9a5b-a936025cdd82 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:11.054893 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4093e6d2-8e3c-46fe-9a5b-a936025cdd82 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:11.055907 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4093e6d2-8e3c-46fe-9a5b-a936025cdd82 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:11.058079 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4093e6d2-8e3c-46fe-9a5b-a936025cdd82 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:11.059039 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4093e6d2-8e3c-46fe-9a5b-a936025cdd82 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:11.060305 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4093e6d2-8e3c-46fe-9a5b-a936025cdd82 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:11.066266 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4093e6d2-8e3c-46fe-9a5b-a936025cdd82 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:11.244660 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-4093e6d2-8e3c-46fe-9a5b-a936025cdd82 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:11.256855 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-4093e6d2-8e3c-46fe-9a5b-a936025cdd82 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1280 microversion: 2.1 time: 0.228121 Aug 09 18:49:11.258032 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 18/41] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:11 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1280 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:11.458691 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-dccdefb2-650e-4db3-8841-51f75e0a2aac tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:11.463803 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-dccdefb2-650e-4db3-8841-51f75e0a2aac tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:11.490666 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dccdefb2-650e-4db3-8841-51f75e0a2aac tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:11.499578 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dccdefb2-650e-4db3-8841-51f75e0a2aac tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:11.501598 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dccdefb2-650e-4db3-8841-51f75e0a2aac tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:11.501598 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dccdefb2-650e-4db3-8841-51f75e0a2aac tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:11.505960 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dccdefb2-650e-4db3-8841-51f75e0a2aac tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:11.509278 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dccdefb2-650e-4db3-8841-51f75e0a2aac tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:11.556274 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-712724e4-b113-47b9-8153-9986818d1ff3 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde48fb289b4c7591658e27ce5ff55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539b956efa1b47799514fbdcac7e250c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:11.594182 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-712724e4-b113-47b9-8153-9986818d1ff3 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] 10.222.0.57 "GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29" status: 200 len: 1314 microversion: 2.1 time: 0.762526 Aug 09 18:49:11.599577 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 24/42] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:10 2022] GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29 => generated 1314 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:11.698885 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-dccdefb2-650e-4db3-8841-51f75e0a2aac tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:11.708503 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-dccdefb2-650e-4db3-8841-51f75e0a2aac tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1296 microversion: 2.1 time: 0.266699 Aug 09 18:49:11.713333 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 19/43] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:11 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1296 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:11.905090 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-253a0c30-9d0c-407c-92bd-e9e93acc70b3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:11.905740 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-253a0c30-9d0c-407c-92bd-e9e93acc70b3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:11.924457 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-253a0c30-9d0c-407c-92bd-e9e93acc70b3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:11.925088 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-253a0c30-9d0c-407c-92bd-e9e93acc70b3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:11.926014 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-253a0c30-9d0c-407c-92bd-e9e93acc70b3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:11.934118 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-253a0c30-9d0c-407c-92bd-e9e93acc70b3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:11.934682 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-253a0c30-9d0c-407c-92bd-e9e93acc70b3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:11.936601 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-253a0c30-9d0c-407c-92bd-e9e93acc70b3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:12.200921 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-a9d7c286-5b57-40ed-b775-e18d5d1dfb68 req-80e76ed1-e131-441f-b318-77acfe488fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5471fc9e-e776-43fb-b11d-a617257a4a29", "tag": "9e855bf9-2f85-4e63-ba2b-8a8b16f67408"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:49:12.214188 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-a9d7c286-5b57-40ed-b775-e18d5d1dfb68 req-80e76ed1-e131-441f-b318-77acfe488fe8 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:12.214956 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-a9d7c286-5b57-40ed-b775-e18d5d1dfb68 req-80e76ed1-e131-441f-b318-77acfe488fe8 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:12.217748 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-a9d7c286-5b57-40ed-b775-e18d5d1dfb68 req-80e76ed1-e131-441f-b318-77acfe488fe8 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:12.264352 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-a9d7c286-5b57-40ed-b775-e18d5d1dfb68 req-80e76ed1-e131-441f-b318-77acfe488fe8 service nova] Creating event network-changed:9e855bf9-2f85-4e63-ba2b-8a8b16f67408 for instance 5471fc9e-e776-43fb-b11d-a617257a4a29 on hv-cinder-82660 Aug 09 18:49:12.270643 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-a9d7c286-5b57-40ed-b775-e18d5d1dfb68 req-80e76ed1-e131-441f-b318-77acfe488fe8 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=124725) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 18:49:12.270643 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-a9d7c286-5b57-40ed-b775-e18d5d1dfb68 req-80e76ed1-e131-441f-b318-77acfe488fe8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124725) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 18:49:12.270643 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3476b6dc-cc2c-48c6-91ef-4c903a1bbfc8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:12.270643 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3476b6dc-cc2c-48c6-91ef-4c903a1bbfc8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:12.270643 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3476b6dc-cc2c-48c6-91ef-4c903a1bbfc8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:12.271046 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3476b6dc-cc2c-48c6-91ef-4c903a1bbfc8 None None] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:12.271046 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3476b6dc-cc2c-48c6-91ef-4c903a1bbfc8 None None] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:12.271046 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3476b6dc-cc2c-48c6-91ef-4c903a1bbfc8 None None] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:12.288133 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-253a0c30-9d0c-407c-92bd-e9e93acc70b3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:12.309829 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.compute.rpcapi [None req-3476b6dc-cc2c-48c6-91ef-4c903a1bbfc8 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 09 18:49:12.310789 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3476b6dc-cc2c-48c6-91ef-4c903a1bbfc8 None None] Releasing lock "compute-rpcapi-router" {{(pid=124725) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 18:49:12.318280 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-253a0c30-9d0c-407c-92bd-e9e93acc70b3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:12.321202 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-253a0c30-9d0c-407c-92bd-e9e93acc70b3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:12.334650 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-253a0c30-9d0c-407c-92bd-e9e93acc70b3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1339 microversion: 2.20 time: 0.433712 Aug 09 18:49:12.338908 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 25/44] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:49:11 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1339 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:49:12.353743 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-76819795-dc44-4258-9e12-008e0920075b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:12.360113 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-76819795-dc44-4258-9e12-008e0920075b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:12.372459 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-3476b6dc-cc2c-48c6-91ef-4c903a1bbfc8 None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.245433 Aug 09 18:49:12.374754 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 20/45] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:49:12.387731 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-76819795-dc44-4258-9e12-008e0920075b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:12.388349 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-76819795-dc44-4258-9e12-008e0920075b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:12.391861 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-76819795-dc44-4258-9e12-008e0920075b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:12.395716 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-76819795-dc44-4258-9e12-008e0920075b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:12.396699 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-76819795-dc44-4258-9e12-008e0920075b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:12.397344 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-76819795-dc44-4258-9e12-008e0920075b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:12.529415 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-76819795-dc44-4258-9e12-008e0920075b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:12.537798 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-76819795-dc44-4258-9e12-008e0920075b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1280 microversion: 2.1 time: 0.196226 Aug 09 18:49:12.538400 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 26/46] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:12 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1280 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:12.621605 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-2007cc3d-645b-45b4-a17b-7aa0edc79569 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:12.629314 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-2007cc3d-645b-45b4-a17b-7aa0edc79569 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] [instance: 5471fc9e-e776-43fb-b11d-a617257a4a29] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:12.632337 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2007cc3d-645b-45b4-a17b-7aa0edc79569 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:12.632792 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2007cc3d-645b-45b4-a17b-7aa0edc79569 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:12.633244 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2007cc3d-645b-45b4-a17b-7aa0edc79569 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:12.634051 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2007cc3d-645b-45b4-a17b-7aa0edc79569 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:12.634659 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2007cc3d-645b-45b4-a17b-7aa0edc79569 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:12.635296 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2007cc3d-645b-45b4-a17b-7aa0edc79569 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:12.733439 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-46da082b-9721-4544-bd27-280c15da4314 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:12.734802 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-46da082b-9721-4544-bd27-280c15da4314 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:12.742953 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-46da082b-9721-4544-bd27-280c15da4314 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:12.743735 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-46da082b-9721-4544-bd27-280c15da4314 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:12.744369 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-46da082b-9721-4544-bd27-280c15da4314 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:12.745327 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-46da082b-9721-4544-bd27-280c15da4314 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:12.746200 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-46da082b-9721-4544-bd27-280c15da4314 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:12.747597 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-46da082b-9721-4544-bd27-280c15da4314 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:12.834556 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-46da082b-9721-4544-bd27-280c15da4314 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:12.845774 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-2007cc3d-645b-45b4-a17b-7aa0edc79569 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde48fb289b4c7591658e27ce5ff55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539b956efa1b47799514fbdcac7e250c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:12.849121 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-46da082b-9721-4544-bd27-280c15da4314 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1296 microversion: 2.1 time: 0.119792 Aug 09 18:49:12.857477 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 27/47] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:12 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1296 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:49:12.859488 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-2007cc3d-645b-45b4-a17b-7aa0edc79569 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] 10.222.0.57 "GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29" status: 200 len: 1314 microversion: 2.1 time: 0.239663 Aug 09 18:49:12.860913 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 21/48] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:12 2022] GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:13.371317 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-7bc975a5-54a1-4a8e-96f5-68ad909742a9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:13.371939 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-7bc975a5-54a1-4a8e-96f5-68ad909742a9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:13.386650 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7bc975a5-54a1-4a8e-96f5-68ad909742a9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:13.389044 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7bc975a5-54a1-4a8e-96f5-68ad909742a9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:13.389697 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7bc975a5-54a1-4a8e-96f5-68ad909742a9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:13.393963 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7bc975a5-54a1-4a8e-96f5-68ad909742a9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:13.393963 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7bc975a5-54a1-4a8e-96f5-68ad909742a9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:13.393963 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7bc975a5-54a1-4a8e-96f5-68ad909742a9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:13.490687 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-7bc975a5-54a1-4a8e-96f5-68ad909742a9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:13.504736 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-7bc975a5-54a1-4a8e-96f5-68ad909742a9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:13.510428 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-7bc975a5-54a1-4a8e-96f5-68ad909742a9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:13.510428 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-7bc975a5-54a1-4a8e-96f5-68ad909742a9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1339 microversion: 2.20 time: 0.146353 Aug 09 18:49:13.510428 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 28/49] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:49:13 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1339 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:49:13.559964 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-4b2dc69d-66fb-4746-a40d-fb633cc6db13 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:13.561177 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-4b2dc69d-66fb-4746-a40d-fb633cc6db13 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:13.567970 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4b2dc69d-66fb-4746-a40d-fb633cc6db13 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:13.568401 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4b2dc69d-66fb-4746-a40d-fb633cc6db13 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:13.568827 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4b2dc69d-66fb-4746-a40d-fb633cc6db13 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:13.569771 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4b2dc69d-66fb-4746-a40d-fb633cc6db13 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:13.573494 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4b2dc69d-66fb-4746-a40d-fb633cc6db13 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:13.577464 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4b2dc69d-66fb-4746-a40d-fb633cc6db13 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:13.737268 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-4b2dc69d-66fb-4746-a40d-fb633cc6db13 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:13.743767 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-4b2dc69d-66fb-4746-a40d-fb633cc6db13 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1322 microversion: 2.1 time: 0.187905 Aug 09 18:49:13.757918 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 22/50] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:13 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:13.870195 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-44d28042-c347-41cd-a4e9-184dcccc735f tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:13.873229 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-44d28042-c347-41cd-a4e9-184dcccc735f tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:13.878975 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-44d28042-c347-41cd-a4e9-184dcccc735f tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:13.879658 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-44d28042-c347-41cd-a4e9-184dcccc735f tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:13.880262 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-44d28042-c347-41cd-a4e9-184dcccc735f tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:13.880962 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-44d28042-c347-41cd-a4e9-184dcccc735f tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:13.881607 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-44d28042-c347-41cd-a4e9-184dcccc735f tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:13.882032 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-44d28042-c347-41cd-a4e9-184dcccc735f tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:13.882691 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-71d8e7a8-2e49-4a7a-9530-edeffd8a9fa9 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:13.883450 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-71d8e7a8-2e49-4a7a-9530-edeffd8a9fa9 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] [instance: 5471fc9e-e776-43fb-b11d-a617257a4a29] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:13.897544 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-71d8e7a8-2e49-4a7a-9530-edeffd8a9fa9 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:13.898475 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-71d8e7a8-2e49-4a7a-9530-edeffd8a9fa9 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:13.899135 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-71d8e7a8-2e49-4a7a-9530-edeffd8a9fa9 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:13.900095 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-71d8e7a8-2e49-4a7a-9530-edeffd8a9fa9 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:13.900750 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-71d8e7a8-2e49-4a7a-9530-edeffd8a9fa9 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:13.901374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-71d8e7a8-2e49-4a7a-9530-edeffd8a9fa9 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:14.109804 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-44d28042-c347-41cd-a4e9-184dcccc735f tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:14.118740 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-44d28042-c347-41cd-a4e9-184dcccc735f tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1363 microversion: 2.1 time: 0.252266 Aug 09 18:49:14.130486 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 29/51] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:13 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:14.151243 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-71d8e7a8-2e49-4a7a-9530-edeffd8a9fa9 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde48fb289b4c7591658e27ce5ff55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539b956efa1b47799514fbdcac7e250c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:14.159393 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-71d8e7a8-2e49-4a7a-9530-edeffd8a9fa9 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] 10.222.0.57 "GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29" status: 200 len: 1314 microversion: 2.1 time: 0.281381 Aug 09 18:49:14.165310 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 23/52] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:13 2022] GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:14.530537 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-204fd4e2-8185-4c3f-89bc-f5a3e48ae21c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:14.531902 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-204fd4e2-8185-4c3f-89bc-f5a3e48ae21c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:14.539362 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-204fd4e2-8185-4c3f-89bc-f5a3e48ae21c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:14.540189 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-204fd4e2-8185-4c3f-89bc-f5a3e48ae21c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:14.540854 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-204fd4e2-8185-4c3f-89bc-f5a3e48ae21c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:14.542299 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-204fd4e2-8185-4c3f-89bc-f5a3e48ae21c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:14.542843 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-204fd4e2-8185-4c3f-89bc-f5a3e48ae21c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:14.543276 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-204fd4e2-8185-4c3f-89bc-f5a3e48ae21c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:14.641123 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-204fd4e2-8185-4c3f-89bc-f5a3e48ae21c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:14.651520 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-204fd4e2-8185-4c3f-89bc-f5a3e48ae21c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:14.652519 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-204fd4e2-8185-4c3f-89bc-f5a3e48ae21c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:14.653671 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-204fd4e2-8185-4c3f-89bc-f5a3e48ae21c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1339 microversion: 2.20 time: 0.127115 Aug 09 18:49:14.654428 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 30/53] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:49:14 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1339 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:49:14.767330 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-56f4b3e0-e5ad-4327-ab82-579fae919fcc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:14.770466 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-56f4b3e0-e5ad-4327-ab82-579fae919fcc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:14.776071 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:49:14.788854 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-56f4b3e0-e5ad-4327-ab82-579fae919fcc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:14.788854 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-56f4b3e0-e5ad-4327-ab82-579fae919fcc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:14.788854 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-56f4b3e0-e5ad-4327-ab82-579fae919fcc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:14.788854 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-56f4b3e0-e5ad-4327-ab82-579fae919fcc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:14.789380 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-56f4b3e0-e5ad-4327-ab82-579fae919fcc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:14.789380 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-56f4b3e0-e5ad-4327-ab82-579fae919fcc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:14.960932 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-56f4b3e0-e5ad-4327-ab82-579fae919fcc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:14.972378 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-56f4b3e0-e5ad-4327-ab82-579fae919fcc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1322 microversion: 2.1 time: 0.210756 Aug 09 18:49:14.973888 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 24/54] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:14 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:15.143889 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-d4491272-16af-4796-a1b5-d4d7aaf693d1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:15.144490 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-d4491272-16af-4796-a1b5-d4d7aaf693d1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:15.150663 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d4491272-16af-4796-a1b5-d4d7aaf693d1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:15.151188 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d4491272-16af-4796-a1b5-d4d7aaf693d1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:15.151615 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d4491272-16af-4796-a1b5-d4d7aaf693d1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:15.152303 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d4491272-16af-4796-a1b5-d4d7aaf693d1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:15.152765 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d4491272-16af-4796-a1b5-d4d7aaf693d1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:15.153206 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d4491272-16af-4796-a1b5-d4d7aaf693d1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:15.189052 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-79004062-3bdf-4ec2-8786-7f55f5f10f5c tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:15.189847 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-79004062-3bdf-4ec2-8786-7f55f5f10f5c tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] [instance: 5471fc9e-e776-43fb-b11d-a617257a4a29] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:15.196742 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-79004062-3bdf-4ec2-8786-7f55f5f10f5c tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:15.197265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-79004062-3bdf-4ec2-8786-7f55f5f10f5c tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:15.197731 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-79004062-3bdf-4ec2-8786-7f55f5f10f5c tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:15.202612 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-79004062-3bdf-4ec2-8786-7f55f5f10f5c tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:15.202612 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-79004062-3bdf-4ec2-8786-7f55f5f10f5c tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:15.202612 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-79004062-3bdf-4ec2-8786-7f55f5f10f5c tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:15.459295 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-d4491272-16af-4796-a1b5-d4d7aaf693d1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:15.463692 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-79004062-3bdf-4ec2-8786-7f55f5f10f5c tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde48fb289b4c7591658e27ce5ff55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539b956efa1b47799514fbdcac7e250c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:15.471609 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-d4491272-16af-4796-a1b5-d4d7aaf693d1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1363 microversion: 2.1 time: 0.332395 Aug 09 18:49:15.474283 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 31/55] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:15 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1363 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:15.477985 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-79004062-3bdf-4ec2-8786-7f55f5f10f5c tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] 10.222.0.57 "GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29" status: 200 len: 1314 microversion: 2.1 time: 0.293416 Aug 09 18:49:15.478821 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 25/56] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:15 2022] GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:49:15.676639 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-890570fe-9f60-4477-9e44-6e2dc4ba8a7e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:15.677254 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-890570fe-9f60-4477-9e44-6e2dc4ba8a7e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:15.679271 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell0:SELECT=6 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:49:15.681686 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:49:15.685054 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-890570fe-9f60-4477-9e44-6e2dc4ba8a7e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:15.690869 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-890570fe-9f60-4477-9e44-6e2dc4ba8a7e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:15.690869 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-890570fe-9f60-4477-9e44-6e2dc4ba8a7e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:15.690869 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-890570fe-9f60-4477-9e44-6e2dc4ba8a7e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:15.690869 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-890570fe-9f60-4477-9e44-6e2dc4ba8a7e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:15.691192 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-890570fe-9f60-4477-9e44-6e2dc4ba8a7e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:15.708561 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell1:SELECT=100 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:49:15.759211 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-890570fe-9f60-4477-9e44-6e2dc4ba8a7e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:15.769473 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-890570fe-9f60-4477-9e44-6e2dc4ba8a7e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:15.772059 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-890570fe-9f60-4477-9e44-6e2dc4ba8a7e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:15.774001 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-890570fe-9f60-4477-9e44-6e2dc4ba8a7e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1339 microversion: 2.20 time: 0.101656 Aug 09 18:49:15.775054 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 32/57] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:49:15 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1339 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:49:16.004261 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b8a28897-acf4-4b64-bd83-c6ce483614c4 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:16.004261 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-b8a28897-acf4-4b64-bd83-c6ce483614c4 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:16.009330 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b8a28897-acf4-4b64-bd83-c6ce483614c4 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:16.010004 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b8a28897-acf4-4b64-bd83-c6ce483614c4 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:16.010775 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b8a28897-acf4-4b64-bd83-c6ce483614c4 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:16.011732 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b8a28897-acf4-4b64-bd83-c6ce483614c4 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:16.012469 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b8a28897-acf4-4b64-bd83-c6ce483614c4 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:16.013116 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b8a28897-acf4-4b64-bd83-c6ce483614c4 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:16.198488 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-b8a28897-acf4-4b64-bd83-c6ce483614c4 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:16.206988 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-b8a28897-acf4-4b64-bd83-c6ce483614c4 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1322 microversion: 2.1 time: 0.210582 Aug 09 18:49:16.209958 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 26/58] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:15 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:16.502539 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-aecc7a03-df49-426f-b3dd-488dcfdc2b51 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:16.505312 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-aecc7a03-df49-426f-b3dd-488dcfdc2b51 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] [instance: 5471fc9e-e776-43fb-b11d-a617257a4a29] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:16.505709 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-d7fc77bb-b88c-4e1e-90f3-8f9dddeb68f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:16.505709 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-d7fc77bb-b88c-4e1e-90f3-8f9dddeb68f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:16.507847 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=26 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:49:16.512648 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-aecc7a03-df49-426f-b3dd-488dcfdc2b51 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:16.513442 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-aecc7a03-df49-426f-b3dd-488dcfdc2b51 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:16.514234 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-aecc7a03-df49-426f-b3dd-488dcfdc2b51 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:16.515127 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-aecc7a03-df49-426f-b3dd-488dcfdc2b51 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:16.515734 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-aecc7a03-df49-426f-b3dd-488dcfdc2b51 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:16.516308 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-aecc7a03-df49-426f-b3dd-488dcfdc2b51 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:16.528352 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d7fc77bb-b88c-4e1e-90f3-8f9dddeb68f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:16.528352 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d7fc77bb-b88c-4e1e-90f3-8f9dddeb68f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:16.528618 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d7fc77bb-b88c-4e1e-90f3-8f9dddeb68f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:16.535913 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d7fc77bb-b88c-4e1e-90f3-8f9dddeb68f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:16.536727 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d7fc77bb-b88c-4e1e-90f3-8f9dddeb68f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:16.537510 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d7fc77bb-b88c-4e1e-90f3-8f9dddeb68f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:16.538860 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=100 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:49:16.702294 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-d7fc77bb-b88c-4e1e-90f3-8f9dddeb68f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:16.715156 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-d7fc77bb-b88c-4e1e-90f3-8f9dddeb68f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1363 microversion: 2.1 time: 0.226499 Aug 09 18:49:16.729558 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 33/59] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:16 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:16.798373 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-3c13c7ac-28db-4f8a-8300-7ef23f14398f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:16.799242 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-3c13c7ac-28db-4f8a-8300-7ef23f14398f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:16.809795 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3c13c7ac-28db-4f8a-8300-7ef23f14398f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:16.811836 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3c13c7ac-28db-4f8a-8300-7ef23f14398f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:16.812604 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3c13c7ac-28db-4f8a-8300-7ef23f14398f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:16.813565 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3c13c7ac-28db-4f8a-8300-7ef23f14398f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:16.814153 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3c13c7ac-28db-4f8a-8300-7ef23f14398f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:16.814743 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3c13c7ac-28db-4f8a-8300-7ef23f14398f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:16.878930 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-aecc7a03-df49-426f-b3dd-488dcfdc2b51 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde48fb289b4c7591658e27ce5ff55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539b956efa1b47799514fbdcac7e250c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:16.889856 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-aecc7a03-df49-426f-b3dd-488dcfdc2b51 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] 10.222.0.57 "GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29" status: 200 len: 1314 microversion: 2.1 time: 0.392920 Aug 09 18:49:16.890846 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 27/60] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:16 2022] GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29 => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:16.929269 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-3c13c7ac-28db-4f8a-8300-7ef23f14398f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:16.941646 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-3c13c7ac-28db-4f8a-8300-7ef23f14398f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:16.943787 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-3c13c7ac-28db-4f8a-8300-7ef23f14398f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:16.945556 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-3c13c7ac-28db-4f8a-8300-7ef23f14398f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1339 microversion: 2.20 time: 0.151613 Aug 09 18:49:16.946215 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 34/61] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:49:16 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1339 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:49:17.228231 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a1c0cf3d-1137-4c04-881b-499ac754d058 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:17.228881 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-a1c0cf3d-1137-4c04-881b-499ac754d058 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:17.241099 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a1c0cf3d-1137-4c04-881b-499ac754d058 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:17.241642 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a1c0cf3d-1137-4c04-881b-499ac754d058 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:17.242070 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a1c0cf3d-1137-4c04-881b-499ac754d058 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:17.242781 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a1c0cf3d-1137-4c04-881b-499ac754d058 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:17.243232 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a1c0cf3d-1137-4c04-881b-499ac754d058 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:17.243660 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a1c0cf3d-1137-4c04-881b-499ac754d058 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:17.433183 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-a1c0cf3d-1137-4c04-881b-499ac754d058 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:17.445276 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-a1c0cf3d-1137-4c04-881b-499ac754d058 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1322 microversion: 2.1 time: 0.220580 Aug 09 18:49:17.446019 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 28/62] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:17 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:49:17.739392 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-c8102f68-6cb8-481f-af48-df2d6ff2ab92 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:17.740715 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-c8102f68-6cb8-481f-af48-df2d6ff2ab92 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:17.748461 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c8102f68-6cb8-481f-af48-df2d6ff2ab92 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:17.749274 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c8102f68-6cb8-481f-af48-df2d6ff2ab92 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:17.749963 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c8102f68-6cb8-481f-af48-df2d6ff2ab92 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:17.750810 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c8102f68-6cb8-481f-af48-df2d6ff2ab92 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:17.751415 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c8102f68-6cb8-481f-af48-df2d6ff2ab92 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:17.752635 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c8102f68-6cb8-481f-af48-df2d6ff2ab92 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:17.917241 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-352e4dd9-0b01-4cc5-8ceb-4980c914ceec tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:17.918695 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-352e4dd9-0b01-4cc5-8ceb-4980c914ceec tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] [instance: 5471fc9e-e776-43fb-b11d-a617257a4a29] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:17.921808 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-c8102f68-6cb8-481f-af48-df2d6ff2ab92 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:17.929542 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-352e4dd9-0b01-4cc5-8ceb-4980c914ceec tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:17.931970 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-352e4dd9-0b01-4cc5-8ceb-4980c914ceec tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:17.932679 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-352e4dd9-0b01-4cc5-8ceb-4980c914ceec tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:17.933456 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-c8102f68-6cb8-481f-af48-df2d6ff2ab92 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1363 microversion: 2.1 time: 0.200273 Aug 09 18:49:17.934082 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 35/63] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:17 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:17.935032 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-352e4dd9-0b01-4cc5-8ceb-4980c914ceec tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:17.940589 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-352e4dd9-0b01-4cc5-8ceb-4980c914ceec tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:17.940589 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-352e4dd9-0b01-4cc5-8ceb-4980c914ceec tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:17.969596 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-c15464e0-9b36-44fe-bd7a-286bc8b860f5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:17.971499 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-c15464e0-9b36-44fe-bd7a-286bc8b860f5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:17.981669 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c15464e0-9b36-44fe-bd7a-286bc8b860f5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:17.983001 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c15464e0-9b36-44fe-bd7a-286bc8b860f5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:17.984963 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c15464e0-9b36-44fe-bd7a-286bc8b860f5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:17.985868 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c15464e0-9b36-44fe-bd7a-286bc8b860f5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:17.988290 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c15464e0-9b36-44fe-bd7a-286bc8b860f5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:17.989424 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c15464e0-9b36-44fe-bd7a-286bc8b860f5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:18.046490 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell0:SELECT=28 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:49:18.167394 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-c15464e0-9b36-44fe-bd7a-286bc8b860f5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:18.184575 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-c15464e0-9b36-44fe-bd7a-286bc8b860f5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:18.186414 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-c15464e0-9b36-44fe-bd7a-286bc8b860f5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:18.187986 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-c15464e0-9b36-44fe-bd7a-286bc8b860f5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1339 microversion: 2.20 time: 0.222330 Aug 09 18:49:18.198275 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 36/64] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:49:17 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1339 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:49:18.246647 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-352e4dd9-0b01-4cc5-8ceb-4980c914ceec tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde48fb289b4c7591658e27ce5ff55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539b956efa1b47799514fbdcac7e250c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:18.258405 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-352e4dd9-0b01-4cc5-8ceb-4980c914ceec tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] 10.222.0.57 "GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29" status: 200 len: 1314 microversion: 2.1 time: 0.349680 Aug 09 18:49:18.263595 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 29/65] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:17 2022] GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29 => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:18.468208 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-17efc11f-3e1c-4aec-aa4c-6272e16ee744 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:18.468389 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-17efc11f-3e1c-4aec-aa4c-6272e16ee744 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:18.479130 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-17efc11f-3e1c-4aec-aa4c-6272e16ee744 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:18.479662 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-17efc11f-3e1c-4aec-aa4c-6272e16ee744 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:18.480103 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-17efc11f-3e1c-4aec-aa4c-6272e16ee744 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:18.480811 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-17efc11f-3e1c-4aec-aa4c-6272e16ee744 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:18.481267 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-17efc11f-3e1c-4aec-aa4c-6272e16ee744 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:18.481729 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-17efc11f-3e1c-4aec-aa4c-6272e16ee744 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:18.711856 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-17efc11f-3e1c-4aec-aa4c-6272e16ee744 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:18.724793 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-17efc11f-3e1c-4aec-aa4c-6272e16ee744 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1322 microversion: 2.1 time: 0.261176 Aug 09 18:49:18.727122 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 37/66] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:18 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1322 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:49:18.957846 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-ec7c5e79-9194-4572-aee0-f4e0c712e1e7 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:18.958839 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-ec7c5e79-9194-4572-aee0-f4e0c712e1e7 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:18.969122 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ec7c5e79-9194-4572-aee0-f4e0c712e1e7 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:18.984589 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ec7c5e79-9194-4572-aee0-f4e0c712e1e7 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:18.985067 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ec7c5e79-9194-4572-aee0-f4e0c712e1e7 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:18.985859 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ec7c5e79-9194-4572-aee0-f4e0c712e1e7 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:18.988196 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ec7c5e79-9194-4572-aee0-f4e0c712e1e7 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:18.988665 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ec7c5e79-9194-4572-aee0-f4e0c712e1e7 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:19.220919 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-916a3b8a-2aa9-4a54-b806-469059379c2e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:19.222229 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-916a3b8a-2aa9-4a54-b806-469059379c2e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:19.232375 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-916a3b8a-2aa9-4a54-b806-469059379c2e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:19.235039 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-916a3b8a-2aa9-4a54-b806-469059379c2e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:19.235730 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-916a3b8a-2aa9-4a54-b806-469059379c2e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:19.237255 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-916a3b8a-2aa9-4a54-b806-469059379c2e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:19.241722 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-916a3b8a-2aa9-4a54-b806-469059379c2e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:19.245232 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-916a3b8a-2aa9-4a54-b806-469059379c2e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:19.436520 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-ec7c5e79-9194-4572-aee0-f4e0c712e1e7 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:19.446841 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-ec7c5e79-9194-4572-aee0-f4e0c712e1e7 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1363 microversion: 2.1 time: 0.495287 Aug 09 18:49:19.461767 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 30/67] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:18 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1363 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:19.466183 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-916a3b8a-2aa9-4a54-b806-469059379c2e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:19.467401 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-1d03b167-d35c-45b6-9b1e-e87e4f33661e tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:19.468251 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-1d03b167-d35c-45b6-9b1e-e87e4f33661e tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] [instance: 5471fc9e-e776-43fb-b11d-a617257a4a29] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:19.476134 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1d03b167-d35c-45b6-9b1e-e87e4f33661e tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:19.476885 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1d03b167-d35c-45b6-9b1e-e87e4f33661e tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:19.477517 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1d03b167-d35c-45b6-9b1e-e87e4f33661e tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:19.478514 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1d03b167-d35c-45b6-9b1e-e87e4f33661e tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:19.479170 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1d03b167-d35c-45b6-9b1e-e87e4f33661e tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:19.479790 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1d03b167-d35c-45b6-9b1e-e87e4f33661e tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:19.482185 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-916a3b8a-2aa9-4a54-b806-469059379c2e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:19.484258 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-916a3b8a-2aa9-4a54-b806-469059379c2e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:19.485843 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-916a3b8a-2aa9-4a54-b806-469059379c2e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1337 microversion: 2.20 time: 0.269655 Aug 09 18:49:19.492493 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 38/68] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:49:19 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1337 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:49:19.756563 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-10a2be3e-ba5d-4096-9179-7504d48b8426 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:19.761982 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-10a2be3e-ba5d-4096-9179-7504d48b8426 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:19.792161 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-10a2be3e-ba5d-4096-9179-7504d48b8426 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:19.792584 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-10a2be3e-ba5d-4096-9179-7504d48b8426 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:19.793098 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-10a2be3e-ba5d-4096-9179-7504d48b8426 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:19.802444 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-10a2be3e-ba5d-4096-9179-7504d48b8426 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:19.802937 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-10a2be3e-ba5d-4096-9179-7504d48b8426 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:19.803381 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-10a2be3e-ba5d-4096-9179-7504d48b8426 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:19.959245 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1d03b167-d35c-45b6-9b1e-e87e4f33661e tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde48fb289b4c7591658e27ce5ff55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539b956efa1b47799514fbdcac7e250c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:19.983406 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-1d03b167-d35c-45b6-9b1e-e87e4f33661e tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] 10.222.0.57 "GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29" status: 200 len: 1314 microversion: 2.1 time: 0.520107 Aug 09 18:49:19.986625 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 31/69] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:19 2022] GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29 => generated 1314 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:20.468224 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-6ade449c-3ea3-40d9-967c-76a7b7fe0a67 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:20.469634 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-6ade449c-3ea3-40d9-967c-76a7b7fe0a67 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:20.477351 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6ade449c-3ea3-40d9-967c-76a7b7fe0a67 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:20.477883 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6ade449c-3ea3-40d9-967c-76a7b7fe0a67 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:20.478316 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6ade449c-3ea3-40d9-967c-76a7b7fe0a67 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:20.479240 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6ade449c-3ea3-40d9-967c-76a7b7fe0a67 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:20.479855 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6ade449c-3ea3-40d9-967c-76a7b7fe0a67 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:20.480552 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6ade449c-3ea3-40d9-967c-76a7b7fe0a67 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:20.645903 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-10a2be3e-ba5d-4096-9179-7504d48b8426 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:20.672124 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-10a2be3e-ba5d-4096-9179-7504d48b8426 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1322 microversion: 2.1 time: 0.913637 Aug 09 18:49:20.687710 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 39/70] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:19 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1322 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:20.693209 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-9d4f35d6-9467-47b0-881b-14ce7fd81df3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:20.694173 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-9d4f35d6-9467-47b0-881b-14ce7fd81df3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:20.708455 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9d4f35d6-9467-47b0-881b-14ce7fd81df3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:20.710339 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9d4f35d6-9467-47b0-881b-14ce7fd81df3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:20.711676 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9d4f35d6-9467-47b0-881b-14ce7fd81df3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:20.712543 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9d4f35d6-9467-47b0-881b-14ce7fd81df3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:20.713910 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9d4f35d6-9467-47b0-881b-14ce7fd81df3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:20.716043 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9d4f35d6-9467-47b0-881b-14ce7fd81df3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:20.786098 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-6ade449c-3ea3-40d9-967c-76a7b7fe0a67 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:20.805354 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-6ade449c-3ea3-40d9-967c-76a7b7fe0a67 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1363 microversion: 2.1 time: 0.340176 Aug 09 18:49:20.807751 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 32/71] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:20 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1363 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:49:21.008499 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-99025daf-e4c8-4bb6-acc1-a8d90cf28001 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:21.009254 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-99025daf-e4c8-4bb6-acc1-a8d90cf28001 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] [instance: 5471fc9e-e776-43fb-b11d-a617257a4a29] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:21.016206 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-99025daf-e4c8-4bb6-acc1-a8d90cf28001 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:21.017163 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-99025daf-e4c8-4bb6-acc1-a8d90cf28001 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:21.018335 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-99025daf-e4c8-4bb6-acc1-a8d90cf28001 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:21.019238 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-99025daf-e4c8-4bb6-acc1-a8d90cf28001 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:21.020085 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-99025daf-e4c8-4bb6-acc1-a8d90cf28001 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:21.020686 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-99025daf-e4c8-4bb6-acc1-a8d90cf28001 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:21.068269 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-9d4f35d6-9467-47b0-881b-14ce7fd81df3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:21.079068 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-9d4f35d6-9467-47b0-881b-14ce7fd81df3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:21.081578 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-9d4f35d6-9467-47b0-881b-14ce7fd81df3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:21.082903 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-9d4f35d6-9467-47b0-881b-14ce7fd81df3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1405 microversion: 2.20 time: 0.393827 Aug 09 18:49:21.084139 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 40/72] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:49:20 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1405 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:49:21.179495 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-99025daf-e4c8-4bb6-acc1-a8d90cf28001 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde48fb289b4c7591658e27ce5ff55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539b956efa1b47799514fbdcac7e250c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:21.188208 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-99025daf-e4c8-4bb6-acc1-a8d90cf28001 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] 10.222.0.57 "GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29" status: 200 len: 1314 microversion: 2.1 time: 0.184537 Aug 09 18:49:21.202472 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 33/73] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:21 2022] GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:49:21.687395 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-74e14b0a-28d4-4941-afeb-2e25948ffabb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:21.688008 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-74e14b0a-28d4-4941-afeb-2e25948ffabb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:21.694080 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-74e14b0a-28d4-4941-afeb-2e25948ffabb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:21.694564 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-74e14b0a-28d4-4941-afeb-2e25948ffabb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:21.694999 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-74e14b0a-28d4-4941-afeb-2e25948ffabb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:21.696240 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-74e14b0a-28d4-4941-afeb-2e25948ffabb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:21.696240 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-74e14b0a-28d4-4941-afeb-2e25948ffabb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:21.699268 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-74e14b0a-28d4-4941-afeb-2e25948ffabb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:21.829762 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-6c0be8fa-3276-4a93-be30-0dff437c6528 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:21.830704 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-6c0be8fa-3276-4a93-be30-0dff437c6528 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:21.837174 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6c0be8fa-3276-4a93-be30-0dff437c6528 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:21.837733 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6c0be8fa-3276-4a93-be30-0dff437c6528 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:21.838171 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6c0be8fa-3276-4a93-be30-0dff437c6528 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:21.838958 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6c0be8fa-3276-4a93-be30-0dff437c6528 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:21.839405 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6c0be8fa-3276-4a93-be30-0dff437c6528 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:21.839836 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6c0be8fa-3276-4a93-be30-0dff437c6528 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:22.003995 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-6c0be8fa-3276-4a93-be30-0dff437c6528 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:22.014312 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-6c0be8fa-3276-4a93-be30-0dff437c6528 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1363 microversion: 2.1 time: 0.188187 Aug 09 18:49:22.015796 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 34/74] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:21 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1363 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:49:22.030364 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-74e14b0a-28d4-4941-afeb-2e25948ffabb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:22.051520 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-74e14b0a-28d4-4941-afeb-2e25948ffabb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1322 microversion: 2.1 time: 0.367764 Aug 09 18:49:22.052302 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 41/75] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:21 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1322 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:22.115056 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-6897629f-8a16-4548-8346-e052eb6a7536 req-92292f21-2c92-4649-a879-600219c27297 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9ba973a-a274-418c-aa03-1f22b8bd8b37", "tag": "eff4b1ff-04ab-46a2-a8e4-5d8ff9b6e64a"}, {"name": "network-changed", "server_uuid": "ec125ee9-c66e-4b3d-9304-ef14211241af", "tag": "f7d1b72c-d7d1-4e45-9a4e-25f70614c7cf"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:49:22.118969 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-986d2b54-f8a6-4e68-8ce2-57030876067f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:22.120178 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-986d2b54-f8a6-4e68-8ce2-57030876067f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:22.128564 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-6897629f-8a16-4548-8346-e052eb6a7536 req-92292f21-2c92-4649-a879-600219c27297 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:22.129370 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-986d2b54-f8a6-4e68-8ce2-57030876067f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:22.129987 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-6897629f-8a16-4548-8346-e052eb6a7536 req-92292f21-2c92-4649-a879-600219c27297 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:22.130088 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-986d2b54-f8a6-4e68-8ce2-57030876067f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:22.130304 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-6897629f-8a16-4548-8346-e052eb6a7536 req-92292f21-2c92-4649-a879-600219c27297 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:22.130882 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-986d2b54-f8a6-4e68-8ce2-57030876067f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:22.132194 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-986d2b54-f8a6-4e68-8ce2-57030876067f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:22.132967 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-986d2b54-f8a6-4e68-8ce2-57030876067f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:22.133560 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-986d2b54-f8a6-4e68-8ce2-57030876067f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:22.147264 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-6897629f-8a16-4548-8346-e052eb6a7536 req-92292f21-2c92-4649-a879-600219c27297 service nova] Creating event network-changed:eff4b1ff-04ab-46a2-a8e4-5d8ff9b6e64a for instance d9ba973a-a274-418c-aa03-1f22b8bd8b37 on hv-cinder-82660 Aug 09 18:49:22.147873 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-6897629f-8a16-4548-8346-e052eb6a7536 req-92292f21-2c92-4649-a879-600219c27297 service nova] Creating event network-changed:f7d1b72c-d7d1-4e45-9a4e-25f70614c7cf for instance ec125ee9-c66e-4b3d-9304-ef14211241af on hv-cinder-82660 Aug 09 18:49:22.156496 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-6897629f-8a16-4548-8346-e052eb6a7536 req-92292f21-2c92-4649-a879-600219c27297 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.121645 Aug 09 18:49:22.157584 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 35/76] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:49:22.211764 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-bdb15cd1-e07f-4390-b54a-3beae32a4f98 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:22.214400 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-bdb15cd1-e07f-4390-b54a-3beae32a4f98 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] [instance: 5471fc9e-e776-43fb-b11d-a617257a4a29] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:22.218784 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bdb15cd1-e07f-4390-b54a-3beae32a4f98 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:22.219269 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bdb15cd1-e07f-4390-b54a-3beae32a4f98 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:22.219707 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bdb15cd1-e07f-4390-b54a-3beae32a4f98 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:22.220976 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bdb15cd1-e07f-4390-b54a-3beae32a4f98 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:22.221499 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bdb15cd1-e07f-4390-b54a-3beae32a4f98 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:22.221922 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bdb15cd1-e07f-4390-b54a-3beae32a4f98 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:22.299565 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=6 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:49:22.302541 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-986d2b54-f8a6-4e68-8ce2-57030876067f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:22.324939 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-986d2b54-f8a6-4e68-8ce2-57030876067f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:22.326866 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-986d2b54-f8a6-4e68-8ce2-57030876067f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:22.328244 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-986d2b54-f8a6-4e68-8ce2-57030876067f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1405 microversion: 2.20 time: 0.216198 Aug 09 18:49:22.329156 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 42/77] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:49:22 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1405 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:49:22.383418 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-bdb15cd1-e07f-4390-b54a-3beae32a4f98 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde48fb289b4c7591658e27ce5ff55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539b956efa1b47799514fbdcac7e250c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:22.391084 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-bdb15cd1-e07f-4390-b54a-3beae32a4f98 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] 10.222.0.57 "GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29" status: 200 len: 1314 microversion: 2.1 time: 0.183471 Aug 09 18:49:22.391585 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 36/78] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:22 2022] GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:49:23.036940 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-c05e784c-7b09-44c5-bce1-09c10e31965e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:23.037582 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-c05e784c-7b09-44c5-bce1-09c10e31965e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:23.049245 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c05e784c-7b09-44c5-bce1-09c10e31965e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:23.049856 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c05e784c-7b09-44c5-bce1-09c10e31965e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:23.050561 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c05e784c-7b09-44c5-bce1-09c10e31965e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:23.051449 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c05e784c-7b09-44c5-bce1-09c10e31965e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:23.052048 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c05e784c-7b09-44c5-bce1-09c10e31965e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:23.052470 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c05e784c-7b09-44c5-bce1-09c10e31965e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:23.071914 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-35e9eaec-f053-4ce1-8ba0-71e0388a4301 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:23.073666 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-35e9eaec-f053-4ce1-8ba0-71e0388a4301 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:23.081344 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-35e9eaec-f053-4ce1-8ba0-71e0388a4301 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:23.083234 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-35e9eaec-f053-4ce1-8ba0-71e0388a4301 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:23.084006 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-35e9eaec-f053-4ce1-8ba0-71e0388a4301 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:23.085301 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-35e9eaec-f053-4ce1-8ba0-71e0388a4301 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:23.086012 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-35e9eaec-f053-4ce1-8ba0-71e0388a4301 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:23.086868 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-35e9eaec-f053-4ce1-8ba0-71e0388a4301 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:23.327955 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-35e9eaec-f053-4ce1-8ba0-71e0388a4301 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:23.338471 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-35e9eaec-f053-4ce1-8ba0-71e0388a4301 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1322 microversion: 2.1 time: 0.269856 Aug 09 18:49:23.339083 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 37/79] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:23 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1322 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:49:23.356222 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-de2fcd88-00a2-46ab-9ac9-8ade9e3871af tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:23.356831 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-de2fcd88-00a2-46ab-9ac9-8ade9e3871af tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:23.363394 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-de2fcd88-00a2-46ab-9ac9-8ade9e3871af tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:23.364466 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-de2fcd88-00a2-46ab-9ac9-8ade9e3871af tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:23.364466 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-de2fcd88-00a2-46ab-9ac9-8ade9e3871af tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:23.365021 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-de2fcd88-00a2-46ab-9ac9-8ade9e3871af tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:23.365445 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-de2fcd88-00a2-46ab-9ac9-8ade9e3871af tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:23.365900 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-de2fcd88-00a2-46ab-9ac9-8ade9e3871af tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:23.506063 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-de2fcd88-00a2-46ab-9ac9-8ade9e3871af tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:23.514151 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-de2fcd88-00a2-46ab-9ac9-8ade9e3871af tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:23.515672 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-de2fcd88-00a2-46ab-9ac9-8ade9e3871af tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:23.516794 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-de2fcd88-00a2-46ab-9ac9-8ade9e3871af tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1405 microversion: 2.20 time: 0.165020 Aug 09 18:49:23.517454 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 38/80] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:49:23 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:49:23.526344 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-959e9273-95db-42ca-af88-75058efd3034 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:23.526942 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-959e9273-95db-42ca-af88-75058efd3034 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] [instance: 5471fc9e-e776-43fb-b11d-a617257a4a29] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:23.532914 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-959e9273-95db-42ca-af88-75058efd3034 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:23.533414 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-959e9273-95db-42ca-af88-75058efd3034 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:23.533886 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-959e9273-95db-42ca-af88-75058efd3034 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:23.534576 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-959e9273-95db-42ca-af88-75058efd3034 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:23.535053 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-959e9273-95db-42ca-af88-75058efd3034 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:23.535484 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-959e9273-95db-42ca-af88-75058efd3034 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:23.684453 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-c05e784c-7b09-44c5-bce1-09c10e31965e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:23.699211 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-c05e784c-7b09-44c5-bce1-09c10e31965e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1363 microversion: 2.1 time: 0.666602 Aug 09 18:49:23.702950 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 43/81] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:23 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1363 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:23.716294 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-61dbf6b9-3b45-43c5-9854-d2025b3beed4 req-ac692805-0ee8-450d-91a0-f9ecdbcedb25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22aac118-db08-4aca-a5e7-3f2cad5e49fd", "tag": "7a0b7c9e-84bf-4317-b8ea-f03780b0d3b2"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:49:23.744751 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-61dbf6b9-3b45-43c5-9854-d2025b3beed4 req-ac692805-0ee8-450d-91a0-f9ecdbcedb25 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:23.746341 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-61dbf6b9-3b45-43c5-9854-d2025b3beed4 req-ac692805-0ee8-450d-91a0-f9ecdbcedb25 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:23.746935 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-61dbf6b9-3b45-43c5-9854-d2025b3beed4 req-ac692805-0ee8-450d-91a0-f9ecdbcedb25 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:23.780385 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-959e9273-95db-42ca-af88-75058efd3034 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde48fb289b4c7591658e27ce5ff55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539b956efa1b47799514fbdcac7e250c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:23.790225 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-61dbf6b9-3b45-43c5-9854-d2025b3beed4 req-ac692805-0ee8-450d-91a0-f9ecdbcedb25 service nova] Creating event network-changed:7a0b7c9e-84bf-4317-b8ea-f03780b0d3b2 for instance 22aac118-db08-4aca-a5e7-3f2cad5e49fd on hv-cinder-82660 Aug 09 18:49:23.791677 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-61dbf6b9-3b45-43c5-9854-d2025b3beed4 req-ac692805-0ee8-450d-91a0-f9ecdbcedb25 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=124726) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 18:49:23.792079 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-61dbf6b9-3b45-43c5-9854-d2025b3beed4 req-ac692805-0ee8-450d-91a0-f9ecdbcedb25 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124726) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 18:49:23.792611 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-959e9273-95db-42ca-af88-75058efd3034 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] 10.222.0.57 "GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29" status: 200 len: 1314 microversion: 2.1 time: 0.269986 Aug 09 18:49:23.793150 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cc7e2e9b-a8fb-4369-8641-c8f00ac9c590 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:23.793276 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 39/82] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:23 2022] GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:23.794084 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cc7e2e9b-a8fb-4369-8641-c8f00ac9c590 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:23.794516 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cc7e2e9b-a8fb-4369-8641-c8f00ac9c590 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:23.795242 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cc7e2e9b-a8fb-4369-8641-c8f00ac9c590 None None] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:23.795694 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cc7e2e9b-a8fb-4369-8641-c8f00ac9c590 None None] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:23.796120 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cc7e2e9b-a8fb-4369-8641-c8f00ac9c590 None None] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:23.810345 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.compute.rpcapi [None req-cc7e2e9b-a8fb-4369-8641-c8f00ac9c590 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 09 18:49:23.811237 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cc7e2e9b-a8fb-4369-8641-c8f00ac9c590 None None] Releasing lock "compute-rpcapi-router" {{(pid=124726) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 18:49:23.828398 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-cc7e2e9b-a8fb-4369-8641-c8f00ac9c590 None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117361 Aug 09 18:49:23.833739 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 44/83] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:49:24.171769 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-37f1d3f4-da5e-418e-a42d-e69fbc9efe48 req-18a6bfd1-2f43-4dfc-ab84-ca00e05a4444 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "650af48c-836d-4078-abb6-4b865a22a7d8", "tag": "7c5b913a-9f7f-4626-bc52-5a16cb854f28"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:49:24.181817 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-37f1d3f4-da5e-418e-a42d-e69fbc9efe48 req-18a6bfd1-2f43-4dfc-ab84-ca00e05a4444 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:24.182299 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-37f1d3f4-da5e-418e-a42d-e69fbc9efe48 req-18a6bfd1-2f43-4dfc-ab84-ca00e05a4444 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:24.182731 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-37f1d3f4-da5e-418e-a42d-e69fbc9efe48 req-18a6bfd1-2f43-4dfc-ab84-ca00e05a4444 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:24.202013 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-37f1d3f4-da5e-418e-a42d-e69fbc9efe48 req-18a6bfd1-2f43-4dfc-ab84-ca00e05a4444 service nova] Creating event network-changed:7c5b913a-9f7f-4626-bc52-5a16cb854f28 for instance 650af48c-836d-4078-abb6-4b865a22a7d8 on hv-cinder-82660 Aug 09 18:49:24.202302 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-37f1d3f4-da5e-418e-a42d-e69fbc9efe48 req-18a6bfd1-2f43-4dfc-ab84-ca00e05a4444 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034236 Aug 09 18:49:24.202899 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 40/84] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:49:24.363223 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-2f6ad811-fa5e-49d9-bc7a-85568ec46cf1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:24.366594 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-2f6ad811-fa5e-49d9-bc7a-85568ec46cf1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:24.372751 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2f6ad811-fa5e-49d9-bc7a-85568ec46cf1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:24.373232 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2f6ad811-fa5e-49d9-bc7a-85568ec46cf1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:24.373697 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2f6ad811-fa5e-49d9-bc7a-85568ec46cf1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:24.374391 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2f6ad811-fa5e-49d9-bc7a-85568ec46cf1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:24.374868 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2f6ad811-fa5e-49d9-bc7a-85568ec46cf1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:24.375300 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2f6ad811-fa5e-49d9-bc7a-85568ec46cf1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:24.538420 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-2f6ad811-fa5e-49d9-bc7a-85568ec46cf1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:24.541562 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-68554a92-aee7-4f32-9695-005518521e06 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:24.542567 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-68554a92-aee7-4f32-9695-005518521e06 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:24.546776 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-2f6ad811-fa5e-49d9-bc7a-85568ec46cf1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1322 microversion: 2.1 time: 0.187932 Aug 09 18:49:24.561083 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 45/85] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:24 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:24.561393 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-68554a92-aee7-4f32-9695-005518521e06 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:24.561393 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-68554a92-aee7-4f32-9695-005518521e06 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:24.561393 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-68554a92-aee7-4f32-9695-005518521e06 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:24.561393 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-68554a92-aee7-4f32-9695-005518521e06 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:24.561696 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-68554a92-aee7-4f32-9695-005518521e06 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:24.561696 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-68554a92-aee7-4f32-9695-005518521e06 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:24.708469 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-68554a92-aee7-4f32-9695-005518521e06 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:24.714969 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-68554a92-aee7-4f32-9695-005518521e06 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:24.716502 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-68554a92-aee7-4f32-9695-005518521e06 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:24.717769 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-68554a92-aee7-4f32-9695-005518521e06 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1405 microversion: 2.20 time: 0.182318 Aug 09 18:49:24.718651 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 41/86] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:49:24 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1405 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:49:24.730392 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-db1db695-b37f-41af-9d42-ff4c52c779a7 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:24.731095 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-db1db695-b37f-41af-9d42-ff4c52c779a7 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:24.745907 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-db1db695-b37f-41af-9d42-ff4c52c779a7 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:24.746564 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-db1db695-b37f-41af-9d42-ff4c52c779a7 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:24.747471 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-db1db695-b37f-41af-9d42-ff4c52c779a7 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:24.748393 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-db1db695-b37f-41af-9d42-ff4c52c779a7 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:24.748983 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-db1db695-b37f-41af-9d42-ff4c52c779a7 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:24.749565 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-db1db695-b37f-41af-9d42-ff4c52c779a7 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:24.815673 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-767c10b0-4f14-437c-9f55-574f51b24ace tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:24.820367 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-767c10b0-4f14-437c-9f55-574f51b24ace tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] [instance: 5471fc9e-e776-43fb-b11d-a617257a4a29] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:24.825503 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-767c10b0-4f14-437c-9f55-574f51b24ace tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:24.826083 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-767c10b0-4f14-437c-9f55-574f51b24ace tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:24.826577 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-767c10b0-4f14-437c-9f55-574f51b24ace tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:24.827334 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-767c10b0-4f14-437c-9f55-574f51b24ace tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:24.827853 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-767c10b0-4f14-437c-9f55-574f51b24ace tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:24.828337 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-767c10b0-4f14-437c-9f55-574f51b24ace tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:25.351449 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-db1db695-b37f-41af-9d42-ff4c52c779a7 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:25.375028 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-db1db695-b37f-41af-9d42-ff4c52c779a7 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1363 microversion: 2.1 time: 0.655880 Aug 09 18:49:25.376739 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 46/87] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:24 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1363 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:25.414962 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-767c10b0-4f14-437c-9f55-574f51b24ace tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde48fb289b4c7591658e27ce5ff55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539b956efa1b47799514fbdcac7e250c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:25.426807 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-767c10b0-4f14-437c-9f55-574f51b24ace tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] 10.222.0.57 "GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29" status: 200 len: 1314 microversion: 2.1 time: 0.615636 Aug 09 18:49:25.427635 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 42/88] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:24 2022] GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29 => generated 1314 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:25.569837 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-d5106d92-4bda-4351-8441-9b1984b64b49 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:25.570463 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-d5106d92-4bda-4351-8441-9b1984b64b49 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:25.581451 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d5106d92-4bda-4351-8441-9b1984b64b49 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:25.586537 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d5106d92-4bda-4351-8441-9b1984b64b49 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:25.587294 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d5106d92-4bda-4351-8441-9b1984b64b49 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:25.588211 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d5106d92-4bda-4351-8441-9b1984b64b49 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:25.588808 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d5106d92-4bda-4351-8441-9b1984b64b49 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:25.589399 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d5106d92-4bda-4351-8441-9b1984b64b49 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:25.752820 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d823470f-3f05-4797-9854-b4ba6b6d0340 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:25.752820 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-d823470f-3f05-4797-9854-b4ba6b6d0340 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:25.762722 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d823470f-3f05-4797-9854-b4ba6b6d0340 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:25.768317 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d823470f-3f05-4797-9854-b4ba6b6d0340 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:25.769024 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d823470f-3f05-4797-9854-b4ba6b6d0340 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:25.770699 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d823470f-3f05-4797-9854-b4ba6b6d0340 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:25.772886 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d823470f-3f05-4797-9854-b4ba6b6d0340 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:25.775754 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d823470f-3f05-4797-9854-b4ba6b6d0340 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:25.920315 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-d5106d92-4bda-4351-8441-9b1984b64b49 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:25.929356 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-d5106d92-4bda-4351-8441-9b1984b64b49 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1322 microversion: 2.1 time: 0.363982 Aug 09 18:49:25.933302 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 47/89] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:25 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1322 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:26.052548 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d823470f-3f05-4797-9854-b4ba6b6d0340 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:26.059665 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d823470f-3f05-4797-9854-b4ba6b6d0340 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:26.061218 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d823470f-3f05-4797-9854-b4ba6b6d0340 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:26.062369 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-d823470f-3f05-4797-9854-b4ba6b6d0340 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1405 microversion: 2.20 time: 0.323010 Aug 09 18:49:26.062971 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 43/90] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:49:25 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1405 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:49:26.397110 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-fde727ae-0f9d-4300-9178-b9c20c367c3b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:26.397749 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-fde727ae-0f9d-4300-9178-b9c20c367c3b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:26.403927 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fde727ae-0f9d-4300-9178-b9c20c367c3b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:26.404405 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fde727ae-0f9d-4300-9178-b9c20c367c3b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:26.404843 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fde727ae-0f9d-4300-9178-b9c20c367c3b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:26.405629 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fde727ae-0f9d-4300-9178-b9c20c367c3b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:26.406086 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fde727ae-0f9d-4300-9178-b9c20c367c3b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:26.406509 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fde727ae-0f9d-4300-9178-b9c20c367c3b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:26.454358 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a4c61913-1f41-4a3f-9bf3-1c1106b995ae tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:26.454358 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-a4c61913-1f41-4a3f-9bf3-1c1106b995ae tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] [instance: 5471fc9e-e776-43fb-b11d-a617257a4a29] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:26.458447 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a4c61913-1f41-4a3f-9bf3-1c1106b995ae tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:26.458940 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a4c61913-1f41-4a3f-9bf3-1c1106b995ae tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:26.459367 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a4c61913-1f41-4a3f-9bf3-1c1106b995ae tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:26.460256 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a4c61913-1f41-4a3f-9bf3-1c1106b995ae tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:26.460737 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a4c61913-1f41-4a3f-9bf3-1c1106b995ae tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:26.461162 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a4c61913-1f41-4a3f-9bf3-1c1106b995ae tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:26.624125 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-a4c61913-1f41-4a3f-9bf3-1c1106b995ae tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde48fb289b4c7591658e27ce5ff55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539b956efa1b47799514fbdcac7e250c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:26.635609 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-a4c61913-1f41-4a3f-9bf3-1c1106b995ae tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] 10.222.0.57 "GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29" status: 200 len: 1314 microversion: 2.1 time: 0.188418 Aug 09 18:49:26.637851 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 44/91] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:26 2022] GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:49:26.774922 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-fde727ae-0f9d-4300-9178-b9c20c367c3b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:26.789692 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-fde727ae-0f9d-4300-9178-b9c20c367c3b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1363 microversion: 2.1 time: 0.390793 Aug 09 18:49:26.789692 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 48/92] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:26 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1363 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:26.952935 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e2b52c7b-228d-47c7-a64a-8671b6907c9e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:26.953898 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e2b52c7b-228d-47c7-a64a-8671b6907c9e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:26.960549 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e2b52c7b-228d-47c7-a64a-8671b6907c9e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:26.962315 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e2b52c7b-228d-47c7-a64a-8671b6907c9e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:26.962315 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e2b52c7b-228d-47c7-a64a-8671b6907c9e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:26.962315 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e2b52c7b-228d-47c7-a64a-8671b6907c9e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:26.962595 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e2b52c7b-228d-47c7-a64a-8671b6907c9e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:26.962996 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e2b52c7b-228d-47c7-a64a-8671b6907c9e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:26.967326 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=100 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:49:27.087966 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-06e68903-9dd3-4bf7-8646-2041b2ffea6e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:27.088667 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-06e68903-9dd3-4bf7-8646-2041b2ffea6e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:27.099334 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-06e68903-9dd3-4bf7-8646-2041b2ffea6e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:27.100202 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-06e68903-9dd3-4bf7-8646-2041b2ffea6e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:27.100756 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-06e68903-9dd3-4bf7-8646-2041b2ffea6e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:27.101824 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-06e68903-9dd3-4bf7-8646-2041b2ffea6e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:27.102822 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-06e68903-9dd3-4bf7-8646-2041b2ffea6e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:27.103874 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-06e68903-9dd3-4bf7-8646-2041b2ffea6e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:27.138885 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell1:SELECT=100 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:49:27.145868 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e2b52c7b-228d-47c7-a64a-8671b6907c9e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:27.156043 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e2b52c7b-228d-47c7-a64a-8671b6907c9e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1322 microversion: 2.1 time: 0.207475 Aug 09 18:49:27.157001 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 45/93] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:26 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:27.298801 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-06e68903-9dd3-4bf7-8646-2041b2ffea6e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:27.308341 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-06e68903-9dd3-4bf7-8646-2041b2ffea6e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:27.309853 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-06e68903-9dd3-4bf7-8646-2041b2ffea6e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:27.317282 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-06e68903-9dd3-4bf7-8646-2041b2ffea6e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1405 microversion: 2.20 time: 0.235281 Aug 09 18:49:27.318293 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 49/94] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:49:27 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1405 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:49:27.665131 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-198d23ba-15de-4384-bed9-a8976c2871bf tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:27.665789 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-198d23ba-15de-4384-bed9-a8976c2871bf tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] [instance: 5471fc9e-e776-43fb-b11d-a617257a4a29] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:27.674518 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-198d23ba-15de-4384-bed9-a8976c2871bf tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:27.675447 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-198d23ba-15de-4384-bed9-a8976c2871bf tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:27.675909 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-198d23ba-15de-4384-bed9-a8976c2871bf tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:27.676606 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-198d23ba-15de-4384-bed9-a8976c2871bf tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:27.677057 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-198d23ba-15de-4384-bed9-a8976c2871bf tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:27.677477 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-198d23ba-15de-4384-bed9-a8976c2871bf tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:27.808486 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-035df1ee-67de-4c1d-8486-fe47a64bb9db tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:27.809965 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-035df1ee-67de-4c1d-8486-fe47a64bb9db tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:27.817087 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-035df1ee-67de-4c1d-8486-fe47a64bb9db tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:27.817699 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-035df1ee-67de-4c1d-8486-fe47a64bb9db tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:27.818372 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-035df1ee-67de-4c1d-8486-fe47a64bb9db tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:27.819164 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-035df1ee-67de-4c1d-8486-fe47a64bb9db tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:27.819305 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-198d23ba-15de-4384-bed9-a8976c2871bf tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde48fb289b4c7591658e27ce5ff55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539b956efa1b47799514fbdcac7e250c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:27.819961 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-035df1ee-67de-4c1d-8486-fe47a64bb9db tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:27.820523 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-035df1ee-67de-4c1d-8486-fe47a64bb9db tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:27.826612 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-198d23ba-15de-4384-bed9-a8976c2871bf tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] 10.222.0.57 "GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29" status: 200 len: 1314 microversion: 2.1 time: 0.165625 Aug 09 18:49:27.827224 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 46/95] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:27 2022] GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:28.012683 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-035df1ee-67de-4c1d-8486-fe47a64bb9db tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:28.018027 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-035df1ee-67de-4c1d-8486-fe47a64bb9db tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1363 microversion: 2.1 time: 0.213239 Aug 09 18:49:28.018595 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 50/96] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:27 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:49:28.177631 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-14db2094-b135-4339-8648-21d470e806be tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:28.178292 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-14db2094-b135-4339-8648-21d470e806be tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:28.184405 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-14db2094-b135-4339-8648-21d470e806be tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:28.184890 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-14db2094-b135-4339-8648-21d470e806be tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:28.185331 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-14db2094-b135-4339-8648-21d470e806be tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:28.186071 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-14db2094-b135-4339-8648-21d470e806be tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:28.186546 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-14db2094-b135-4339-8648-21d470e806be tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:28.187089 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-14db2094-b135-4339-8648-21d470e806be tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:28.346615 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-6267fc4c-c1bd-4c35-aae1-48ff619eaab4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:28.347292 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-6267fc4c-c1bd-4c35-aae1-48ff619eaab4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:28.353822 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6267fc4c-c1bd-4c35-aae1-48ff619eaab4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:28.383926 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6267fc4c-c1bd-4c35-aae1-48ff619eaab4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:28.383926 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6267fc4c-c1bd-4c35-aae1-48ff619eaab4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:28.383926 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6267fc4c-c1bd-4c35-aae1-48ff619eaab4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:28.383926 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6267fc4c-c1bd-4c35-aae1-48ff619eaab4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:28.384336 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-14db2094-b135-4339-8648-21d470e806be tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:28.384441 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6267fc4c-c1bd-4c35-aae1-48ff619eaab4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:28.384522 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-14db2094-b135-4339-8648-21d470e806be tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1322 microversion: 2.1 time: 0.192330 Aug 09 18:49:28.384522 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 47/97] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:28 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:28.509143 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-6267fc4c-c1bd-4c35-aae1-48ff619eaab4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:28.523525 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-6267fc4c-c1bd-4c35-aae1-48ff619eaab4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:28.524181 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-6267fc4c-c1bd-4c35-aae1-48ff619eaab4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:28.526416 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-6267fc4c-c1bd-4c35-aae1-48ff619eaab4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1405 microversion: 2.20 time: 0.184786 Aug 09 18:49:28.527743 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 51/98] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:49:28 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1405 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:49:28.848054 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5b374840-79f5-47da-ad8b-8d73cc8a44a2 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:28.848688 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-5b374840-79f5-47da-ad8b-8d73cc8a44a2 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] [instance: 5471fc9e-e776-43fb-b11d-a617257a4a29] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:28.855540 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5b374840-79f5-47da-ad8b-8d73cc8a44a2 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:28.856035 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5b374840-79f5-47da-ad8b-8d73cc8a44a2 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:28.856469 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5b374840-79f5-47da-ad8b-8d73cc8a44a2 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:28.857188 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5b374840-79f5-47da-ad8b-8d73cc8a44a2 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:28.857669 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5b374840-79f5-47da-ad8b-8d73cc8a44a2 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:28.858094 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5b374840-79f5-47da-ad8b-8d73cc8a44a2 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:28.999222 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5b374840-79f5-47da-ad8b-8d73cc8a44a2 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde48fb289b4c7591658e27ce5ff55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539b956efa1b47799514fbdcac7e250c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:29.007503 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-5b374840-79f5-47da-ad8b-8d73cc8a44a2 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] 10.222.0.57 "GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29" status: 200 len: 1314 microversion: 2.1 time: 0.163936 Aug 09 18:49:29.008110 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 48/99] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:28 2022] GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:29.041301 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-105249b1-f053-4081-a104-11bc7da0fef8 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:29.042061 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-105249b1-f053-4081-a104-11bc7da0fef8 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:29.049219 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-105249b1-f053-4081-a104-11bc7da0fef8 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:29.049905 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-105249b1-f053-4081-a104-11bc7da0fef8 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:29.050830 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-105249b1-f053-4081-a104-11bc7da0fef8 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:29.051681 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-105249b1-f053-4081-a104-11bc7da0fef8 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:29.052237 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-105249b1-f053-4081-a104-11bc7da0fef8 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:29.052787 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-105249b1-f053-4081-a104-11bc7da0fef8 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:29.190794 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-105249b1-f053-4081-a104-11bc7da0fef8 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:29.198825 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-105249b1-f053-4081-a104-11bc7da0fef8 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1363 microversion: 2.1 time: 0.162637 Aug 09 18:49:29.199014 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 52/100] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:29 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:29.399641 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-4dfd916a-3345-41f7-aab3-5c3058de5dce tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:29.400328 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-4dfd916a-3345-41f7-aab3-5c3058de5dce tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:29.406337 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4dfd916a-3345-41f7-aab3-5c3058de5dce tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:29.406817 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4dfd916a-3345-41f7-aab3-5c3058de5dce tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:29.407247 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4dfd916a-3345-41f7-aab3-5c3058de5dce tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:29.407936 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4dfd916a-3345-41f7-aab3-5c3058de5dce tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:29.408385 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4dfd916a-3345-41f7-aab3-5c3058de5dce tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:29.408807 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4dfd916a-3345-41f7-aab3-5c3058de5dce tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:29.548556 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-4dfd916a-3345-41f7-aab3-5c3058de5dce tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:29.552348 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-d976dd83-335b-487e-8fd2-23d45ef073b9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:29.552872 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-d976dd83-335b-487e-8fd2-23d45ef073b9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:29.559437 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-4dfd916a-3345-41f7-aab3-5c3058de5dce tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1322 microversion: 2.1 time: 0.163439 Aug 09 18:49:29.560422 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d976dd83-335b-487e-8fd2-23d45ef073b9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:29.561067 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d976dd83-335b-487e-8fd2-23d45ef073b9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:29.561362 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 49/101] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:29 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:29.561918 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d976dd83-335b-487e-8fd2-23d45ef073b9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:29.562823 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d976dd83-335b-487e-8fd2-23d45ef073b9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:29.564490 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d976dd83-335b-487e-8fd2-23d45ef073b9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:29.565810 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d976dd83-335b-487e-8fd2-23d45ef073b9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:29.737954 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-d976dd83-335b-487e-8fd2-23d45ef073b9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:29.745937 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-d976dd83-335b-487e-8fd2-23d45ef073b9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:29.747525 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-d976dd83-335b-487e-8fd2-23d45ef073b9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:29.748662 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-d976dd83-335b-487e-8fd2-23d45ef073b9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1405 microversion: 2.20 time: 0.201548 Aug 09 18:49:29.749229 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 53/102] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:49:29 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1405 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:49:30.030404 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-31661ef6-f9a2-4e5b-b774-a2b413a80d95 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:30.031088 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-31661ef6-f9a2-4e5b-b774-a2b413a80d95 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] [instance: 5471fc9e-e776-43fb-b11d-a617257a4a29] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:30.038734 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-31661ef6-f9a2-4e5b-b774-a2b413a80d95 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:30.039794 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-31661ef6-f9a2-4e5b-b774-a2b413a80d95 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:30.040437 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-31661ef6-f9a2-4e5b-b774-a2b413a80d95 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:30.041356 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-31661ef6-f9a2-4e5b-b774-a2b413a80d95 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:30.042048 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-31661ef6-f9a2-4e5b-b774-a2b413a80d95 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:30.042674 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-31661ef6-f9a2-4e5b-b774-a2b413a80d95 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:30.205657 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-31661ef6-f9a2-4e5b-b774-a2b413a80d95 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde48fb289b4c7591658e27ce5ff55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539b956efa1b47799514fbdcac7e250c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:30.216486 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-31661ef6-f9a2-4e5b-b774-a2b413a80d95 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] 10.222.0.57 "GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29" status: 200 len: 1314 microversion: 2.1 time: 0.191901 Aug 09 18:49:30.217507 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 50/103] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:30 2022] GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:30.230591 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-4ddd9e82-860f-4e76-a113-252a7776e97e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:30.232565 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-4ddd9e82-860f-4e76-a113-252a7776e97e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:30.273019 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4ddd9e82-860f-4e76-a113-252a7776e97e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:30.276846 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4ddd9e82-860f-4e76-a113-252a7776e97e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:30.277473 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4ddd9e82-860f-4e76-a113-252a7776e97e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:30.278452 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4ddd9e82-860f-4e76-a113-252a7776e97e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:30.279052 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4ddd9e82-860f-4e76-a113-252a7776e97e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:30.280750 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4ddd9e82-860f-4e76-a113-252a7776e97e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:30.585080 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c6abc133-05ac-4623-ac52-cb6295557eeb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:30.585735 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-c6abc133-05ac-4623-ac52-cb6295557eeb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:30.603391 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c6abc133-05ac-4623-ac52-cb6295557eeb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:30.603895 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c6abc133-05ac-4623-ac52-cb6295557eeb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:30.604334 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c6abc133-05ac-4623-ac52-cb6295557eeb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:30.605047 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c6abc133-05ac-4623-ac52-cb6295557eeb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:30.605500 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c6abc133-05ac-4623-ac52-cb6295557eeb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:30.605952 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c6abc133-05ac-4623-ac52-cb6295557eeb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:30.916107 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-4ddd9e82-860f-4e76-a113-252a7776e97e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:30.931671 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-4ddd9e82-860f-4e76-a113-252a7776e97e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1363 microversion: 2.1 time: 0.716002 Aug 09 18:49:30.939600 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 54/104] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:30 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1363 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:30.939600 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-d5091f05-ec04-477b-9085-7ae4fc851aa1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:30.940633 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-d5091f05-ec04-477b-9085-7ae4fc851aa1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:30.947924 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d5091f05-ec04-477b-9085-7ae4fc851aa1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:30.948660 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d5091f05-ec04-477b-9085-7ae4fc851aa1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:30.949287 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d5091f05-ec04-477b-9085-7ae4fc851aa1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:30.950034 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d5091f05-ec04-477b-9085-7ae4fc851aa1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:30.950789 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d5091f05-ec04-477b-9085-7ae4fc851aa1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:30.951438 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d5091f05-ec04-477b-9085-7ae4fc851aa1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:31.008031 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-c6abc133-05ac-4623-ac52-cb6295557eeb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:31.017801 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-c6abc133-05ac-4623-ac52-cb6295557eeb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1322 microversion: 2.1 time: 0.436262 Aug 09 18:49:31.019636 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 51/105] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:30 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1322 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:31.223307 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-d5091f05-ec04-477b-9085-7ae4fc851aa1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:31.233436 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-d5091f05-ec04-477b-9085-7ae4fc851aa1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:31.236771 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-d5091f05-ec04-477b-9085-7ae4fc851aa1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:31.238348 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-d5091f05-ec04-477b-9085-7ae4fc851aa1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1405 microversion: 2.20 time: 0.304461 Aug 09 18:49:31.239520 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 55/106] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:49:30 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1405 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:49:31.251973 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-020679c1-f559-4f81-8f54-6c542c9fc212 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:31.252708 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-020679c1-f559-4f81-8f54-6c542c9fc212 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] [instance: 5471fc9e-e776-43fb-b11d-a617257a4a29] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:31.260395 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-020679c1-f559-4f81-8f54-6c542c9fc212 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:31.260941 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-020679c1-f559-4f81-8f54-6c542c9fc212 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:31.261373 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-020679c1-f559-4f81-8f54-6c542c9fc212 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:31.262093 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-020679c1-f559-4f81-8f54-6c542c9fc212 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:31.262741 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-020679c1-f559-4f81-8f54-6c542c9fc212 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:31.263317 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-020679c1-f559-4f81-8f54-6c542c9fc212 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:31.442363 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-020679c1-f559-4f81-8f54-6c542c9fc212 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde48fb289b4c7591658e27ce5ff55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539b956efa1b47799514fbdcac7e250c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:31.450011 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-020679c1-f559-4f81-8f54-6c542c9fc212 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] 10.222.0.57 "GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29" status: 200 len: 1314 microversion: 2.1 time: 0.214383 Aug 09 18:49:31.450973 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 52/107] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:31 2022] GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:49:31.953785 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-02460cd7-f299-498f-8195-0c07872c81db tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:31.955395 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-02460cd7-f299-498f-8195-0c07872c81db tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:31.961933 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-02460cd7-f299-498f-8195-0c07872c81db tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:31.962776 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-02460cd7-f299-498f-8195-0c07872c81db tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:31.963468 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-02460cd7-f299-498f-8195-0c07872c81db tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:31.964441 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-02460cd7-f299-498f-8195-0c07872c81db tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:31.965324 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-02460cd7-f299-498f-8195-0c07872c81db tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:31.966022 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-02460cd7-f299-498f-8195-0c07872c81db tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:32.043666 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-9fafda31-3661-438a-9217-ecae28e16b62 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:32.050661 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-9fafda31-3661-438a-9217-ecae28e16b62 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:32.065350 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9fafda31-3661-438a-9217-ecae28e16b62 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:32.068385 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9fafda31-3661-438a-9217-ecae28e16b62 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:32.070040 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9fafda31-3661-438a-9217-ecae28e16b62 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:32.071983 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9fafda31-3661-438a-9217-ecae28e16b62 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:32.072995 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9fafda31-3661-438a-9217-ecae28e16b62 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:32.075179 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9fafda31-3661-438a-9217-ecae28e16b62 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:32.291392 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-9fafda31-3661-438a-9217-ecae28e16b62 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:32.300519 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-9fafda31-3661-438a-9217-ecae28e16b62 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1322 microversion: 2.1 time: 0.263002 Aug 09 18:49:32.301908 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 53/108] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:32 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1322 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:32.307157 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-89852f73-2775-4406-a6b3-adf26bd64ad4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:32.308376 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-89852f73-2775-4406-a6b3-adf26bd64ad4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:32.320659 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-89852f73-2775-4406-a6b3-adf26bd64ad4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:32.322175 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-89852f73-2775-4406-a6b3-adf26bd64ad4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:32.323265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-89852f73-2775-4406-a6b3-adf26bd64ad4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:32.325205 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-89852f73-2775-4406-a6b3-adf26bd64ad4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:32.333626 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-02460cd7-f299-498f-8195-0c07872c81db tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:32.337113 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-89852f73-2775-4406-a6b3-adf26bd64ad4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:32.338229 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-89852f73-2775-4406-a6b3-adf26bd64ad4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:32.343631 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-02460cd7-f299-498f-8195-0c07872c81db tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1363 microversion: 2.1 time: 0.393916 Aug 09 18:49:32.345956 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 56/109] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:31 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1363 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:32.472942 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-fcda61fe-4911-4559-ab13-cb1e935e7c83 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:32.472942 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-fcda61fe-4911-4559-ab13-cb1e935e7c83 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] [instance: 5471fc9e-e776-43fb-b11d-a617257a4a29] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:32.486461 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fcda61fe-4911-4559-ab13-cb1e935e7c83 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:32.486980 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fcda61fe-4911-4559-ab13-cb1e935e7c83 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:32.487425 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fcda61fe-4911-4559-ab13-cb1e935e7c83 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:32.488138 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fcda61fe-4911-4559-ab13-cb1e935e7c83 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:32.488592 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fcda61fe-4911-4559-ab13-cb1e935e7c83 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:32.503045 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fcda61fe-4911-4559-ab13-cb1e935e7c83 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:32.539926 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-89852f73-2775-4406-a6b3-adf26bd64ad4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:32.549460 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-89852f73-2775-4406-a6b3-adf26bd64ad4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:32.552021 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-89852f73-2775-4406-a6b3-adf26bd64ad4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:32.559135 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-89852f73-2775-4406-a6b3-adf26bd64ad4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1405 microversion: 2.20 time: 0.255867 Aug 09 18:49:32.565104 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 54/110] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:49:32 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1405 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:49:32.679401 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-fcda61fe-4911-4559-ab13-cb1e935e7c83 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde48fb289b4c7591658e27ce5ff55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539b956efa1b47799514fbdcac7e250c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:32.686724 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-fcda61fe-4911-4559-ab13-cb1e935e7c83 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] 10.222.0.57 "GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29" status: 200 len: 1314 microversion: 2.1 time: 0.219418 Aug 09 18:49:32.688211 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 57/111] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:32 2022] GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:49:33.063324 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-72556fe9-5b12-402c-b706-d61067123e90 req-d09d6ca2-0c23-47f3-a0cf-009af620b5dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5471fc9e-e776-43fb-b11d-a617257a4a29", "name": "network-vif-plugged", "status": "completed", "tag": "9e855bf9-2f85-4e63-ba2b-8a8b16f67408"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:49:33.067603 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-72556fe9-5b12-402c-b706-d61067123e90 req-d09d6ca2-0c23-47f3-a0cf-009af620b5dd service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:33.068066 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-72556fe9-5b12-402c-b706-d61067123e90 req-d09d6ca2-0c23-47f3-a0cf-009af620b5dd service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:33.068486 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-72556fe9-5b12-402c-b706-d61067123e90 req-d09d6ca2-0c23-47f3-a0cf-009af620b5dd service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:33.079373 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-72556fe9-5b12-402c-b706-d61067123e90 req-d09d6ca2-0c23-47f3-a0cf-009af620b5dd service nova] Creating event network-vif-plugged:9e855bf9-2f85-4e63-ba2b-8a8b16f67408 for instance 5471fc9e-e776-43fb-b11d-a617257a4a29 on hv-cinder-82660 Aug 09 18:49:33.084599 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-72556fe9-5b12-402c-b706-d61067123e90 req-d09d6ca2-0c23-47f3-a0cf-009af620b5dd service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163646 Aug 09 18:49:33.085185 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 55/112] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:49:33.323458 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-7261e8d1-2304-433f-87d4-830c61526fe1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:33.327839 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-7261e8d1-2304-433f-87d4-830c61526fe1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:33.346293 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7261e8d1-2304-433f-87d4-830c61526fe1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:33.347472 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7261e8d1-2304-433f-87d4-830c61526fe1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:33.347912 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7261e8d1-2304-433f-87d4-830c61526fe1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:33.348814 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7261e8d1-2304-433f-87d4-830c61526fe1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:33.349223 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7261e8d1-2304-433f-87d4-830c61526fe1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:33.354469 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7261e8d1-2304-433f-87d4-830c61526fe1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:33.395598 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-faa09fc5-2b0d-4222-b9a1-dfb4a3db7e12 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:33.395598 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-faa09fc5-2b0d-4222-b9a1-dfb4a3db7e12 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:33.395598 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-faa09fc5-2b0d-4222-b9a1-dfb4a3db7e12 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:33.395598 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-faa09fc5-2b0d-4222-b9a1-dfb4a3db7e12 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:33.396329 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-faa09fc5-2b0d-4222-b9a1-dfb4a3db7e12 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:33.396329 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-faa09fc5-2b0d-4222-b9a1-dfb4a3db7e12 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:33.396329 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-faa09fc5-2b0d-4222-b9a1-dfb4a3db7e12 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:33.396329 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-faa09fc5-2b0d-4222-b9a1-dfb4a3db7e12 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:33.578709 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-faa09fc5-2b0d-4222-b9a1-dfb4a3db7e12 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:33.586379 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-7261e8d1-2304-433f-87d4-830c61526fe1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:33.588323 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-faa09fc5-2b0d-4222-b9a1-dfb4a3db7e12 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1363 microversion: 2.1 time: 0.207458 Aug 09 18:49:33.590347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 56/113] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:33 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:49:33.596795 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a21c6794-1504-4591-a9f6-22875b4d0e5a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:33.597517 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-a21c6794-1504-4591-a9f6-22875b4d0e5a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:33.608591 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-7261e8d1-2304-433f-87d4-830c61526fe1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1322 microversion: 2.1 time: 0.289113 Aug 09 18:49:33.614123 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a21c6794-1504-4591-a9f6-22875b4d0e5a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:33.614682 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a21c6794-1504-4591-a9f6-22875b4d0e5a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:33.615121 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a21c6794-1504-4591-a9f6-22875b4d0e5a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:33.615930 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a21c6794-1504-4591-a9f6-22875b4d0e5a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:33.616384 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a21c6794-1504-4591-a9f6-22875b4d0e5a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:33.616834 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a21c6794-1504-4591-a9f6-22875b4d0e5a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:33.621713 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 58/114] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:33 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1322 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:33.710252 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-e0b79c12-2224-4ea1-bfc1-04af912061df tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:33.714484 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-e0b79c12-2224-4ea1-bfc1-04af912061df tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] [instance: 5471fc9e-e776-43fb-b11d-a617257a4a29] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:33.723776 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e0b79c12-2224-4ea1-bfc1-04af912061df tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:33.724490 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e0b79c12-2224-4ea1-bfc1-04af912061df tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:33.725061 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e0b79c12-2224-4ea1-bfc1-04af912061df tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:33.725986 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e0b79c12-2224-4ea1-bfc1-04af912061df tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:33.726549 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e0b79c12-2224-4ea1-bfc1-04af912061df tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:33.730012 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e0b79c12-2224-4ea1-bfc1-04af912061df tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:33.784410 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-a21c6794-1504-4591-a9f6-22875b4d0e5a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:33.794360 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-a21c6794-1504-4591-a9f6-22875b4d0e5a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:33.796123 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-a21c6794-1504-4591-a9f6-22875b4d0e5a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:33.798181 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-a21c6794-1504-4591-a9f6-22875b4d0e5a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1405 microversion: 2.20 time: 0.205583 Aug 09 18:49:33.798900 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 57/115] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:49:33 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1405 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:49:33.809246 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell0:SELECT=2 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:49:33.916040 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-e0b79c12-2224-4ea1-bfc1-04af912061df tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde48fb289b4c7591658e27ce5ff55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539b956efa1b47799514fbdcac7e250c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:33.931123 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-e0b79c12-2224-4ea1-bfc1-04af912061df tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] 10.222.0.57 "GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29" status: 200 len: 1314 microversion: 2.1 time: 0.226737 Aug 09 18:49:33.931722 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 59/116] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:33 2022] GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:49:34.609901 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e1d18c9a-5581-4b20-8034-f9e0cfe2f2bc tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:34.611132 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e1d18c9a-5581-4b20-8034-f9e0cfe2f2bc tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:34.617181 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e1d18c9a-5581-4b20-8034-f9e0cfe2f2bc tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:34.617686 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e1d18c9a-5581-4b20-8034-f9e0cfe2f2bc tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:34.618113 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e1d18c9a-5581-4b20-8034-f9e0cfe2f2bc tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:34.618793 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e1d18c9a-5581-4b20-8034-f9e0cfe2f2bc tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:34.619242 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e1d18c9a-5581-4b20-8034-f9e0cfe2f2bc tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:34.619652 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e1d18c9a-5581-4b20-8034-f9e0cfe2f2bc tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:34.628443 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-756f80fe-d7fa-49bd-b496-2893926f87ce tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:34.629593 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-756f80fe-d7fa-49bd-b496-2893926f87ce tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:34.637421 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-756f80fe-d7fa-49bd-b496-2893926f87ce tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:34.639750 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-756f80fe-d7fa-49bd-b496-2893926f87ce tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:34.643920 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-756f80fe-d7fa-49bd-b496-2893926f87ce tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:34.643920 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-756f80fe-d7fa-49bd-b496-2893926f87ce tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:34.643920 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-756f80fe-d7fa-49bd-b496-2893926f87ce tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:34.643920 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-756f80fe-d7fa-49bd-b496-2893926f87ce tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:34.791526 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e1d18c9a-5581-4b20-8034-f9e0cfe2f2bc tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:34.800207 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e1d18c9a-5581-4b20-8034-f9e0cfe2f2bc tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1363 microversion: 2.1 time: 0.193790 Aug 09 18:49:34.800841 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 58/117] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:34 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:34.820572 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-1e85cc05-947f-4c43-a3ff-49fe3bdfab56 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:34.821241 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-1e85cc05-947f-4c43-a3ff-49fe3bdfab56 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:34.827807 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1e85cc05-947f-4c43-a3ff-49fe3bdfab56 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:34.828311 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1e85cc05-947f-4c43-a3ff-49fe3bdfab56 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:34.828764 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1e85cc05-947f-4c43-a3ff-49fe3bdfab56 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:34.830040 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1e85cc05-947f-4c43-a3ff-49fe3bdfab56 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:34.830491 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1e85cc05-947f-4c43-a3ff-49fe3bdfab56 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:34.830937 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1e85cc05-947f-4c43-a3ff-49fe3bdfab56 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:34.988417 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1e85cc05-947f-4c43-a3ff-49fe3bdfab56 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:34.999566 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1e85cc05-947f-4c43-a3ff-49fe3bdfab56 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:35.001968 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1e85cc05-947f-4c43-a3ff-49fe3bdfab56 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:35.003434 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-1e85cc05-947f-4c43-a3ff-49fe3bdfab56 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1405 microversion: 2.20 time: 0.186964 Aug 09 18:49:35.016438 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 59/118] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:49:34 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1405 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:49:35.041876 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b456de43-d72c-4715-a1c0-c6633e5ffe4d tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:35.043924 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-b456de43-d72c-4715-a1c0-c6633e5ffe4d tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] [instance: 5471fc9e-e776-43fb-b11d-a617257a4a29] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:35.050416 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b456de43-d72c-4715-a1c0-c6633e5ffe4d tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:35.051181 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b456de43-d72c-4715-a1c0-c6633e5ffe4d tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:35.051616 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b456de43-d72c-4715-a1c0-c6633e5ffe4d tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:35.052470 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b456de43-d72c-4715-a1c0-c6633e5ffe4d tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:35.052812 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b456de43-d72c-4715-a1c0-c6633e5ffe4d tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:35.053239 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b456de43-d72c-4715-a1c0-c6633e5ffe4d tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:35.088661 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-756f80fe-d7fa-49bd-b496-2893926f87ce tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:35.096386 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-756f80fe-d7fa-49bd-b496-2893926f87ce tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1322 microversion: 2.1 time: 0.471870 Aug 09 18:49:35.096984 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 60/119] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:34 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1322 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:35.101906 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-88b6f3e1-5e0b-4bbe-a5f6-a47934a45420 req-9bee7b55-63ee-46f5-a82f-7aaffbdca89c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "650af48c-836d-4078-abb6-4b865a22a7d8", "name": "network-vif-plugged", "status": "completed", "tag": "7c5b913a-9f7f-4626-bc52-5a16cb854f28"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:49:35.112776 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-88b6f3e1-5e0b-4bbe-a5f6-a47934a45420 req-9bee7b55-63ee-46f5-a82f-7aaffbdca89c service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:35.112776 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-88b6f3e1-5e0b-4bbe-a5f6-a47934a45420 req-9bee7b55-63ee-46f5-a82f-7aaffbdca89c service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:35.112776 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-88b6f3e1-5e0b-4bbe-a5f6-a47934a45420 req-9bee7b55-63ee-46f5-a82f-7aaffbdca89c service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:35.124071 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-88b6f3e1-5e0b-4bbe-a5f6-a47934a45420 req-9bee7b55-63ee-46f5-a82f-7aaffbdca89c service nova] Creating event network-vif-plugged:7c5b913a-9f7f-4626-bc52-5a16cb854f28 for instance 650af48c-836d-4078-abb6-4b865a22a7d8 on hv-cinder-82660 Aug 09 18:49:35.130329 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-88b6f3e1-5e0b-4bbe-a5f6-a47934a45420 req-9bee7b55-63ee-46f5-a82f-7aaffbdca89c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032122 Aug 09 18:49:35.131214 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 61/120] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:49:35.240390 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-b456de43-d72c-4715-a1c0-c6633e5ffe4d tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde48fb289b4c7591658e27ce5ff55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539b956efa1b47799514fbdcac7e250c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:35.247912 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-b456de43-d72c-4715-a1c0-c6633e5ffe4d tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] 10.222.0.57 "GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29" status: 200 len: 1314 microversion: 2.1 time: 0.223522 Aug 09 18:49:35.248536 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 60/121] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:35 2022] GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:35.820815 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-b7655f11-a2d6-4406-a476-6ddf02827e57 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:35.822604 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-b7655f11-a2d6-4406-a476-6ddf02827e57 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:35.833996 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b7655f11-a2d6-4406-a476-6ddf02827e57 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:35.834495 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b7655f11-a2d6-4406-a476-6ddf02827e57 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:35.834930 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b7655f11-a2d6-4406-a476-6ddf02827e57 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:35.835633 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b7655f11-a2d6-4406-a476-6ddf02827e57 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:35.836083 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b7655f11-a2d6-4406-a476-6ddf02827e57 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:35.836503 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b7655f11-a2d6-4406-a476-6ddf02827e57 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:35.968851 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-b7655f11-a2d6-4406-a476-6ddf02827e57 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:35.976943 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-b7655f11-a2d6-4406-a476-6ddf02827e57 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1363 microversion: 2.1 time: 0.160358 Aug 09 18:49:35.977514 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 62/122] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:35 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:36.029636 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-8de47fa1-9de3-4695-acbe-1b3288385138 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:36.030240 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-8de47fa1-9de3-4695-acbe-1b3288385138 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:36.036686 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8de47fa1-9de3-4695-acbe-1b3288385138 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:36.037179 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8de47fa1-9de3-4695-acbe-1b3288385138 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:36.037630 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8de47fa1-9de3-4695-acbe-1b3288385138 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:36.038328 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8de47fa1-9de3-4695-acbe-1b3288385138 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:36.038816 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8de47fa1-9de3-4695-acbe-1b3288385138 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:36.039244 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8de47fa1-9de3-4695-acbe-1b3288385138 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:36.116904 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-53c33b04-4af4-4fc9-b3cd-e6f8e64b9fff tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:36.117648 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-53c33b04-4af4-4fc9-b3cd-e6f8e64b9fff tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:36.123909 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-53c33b04-4af4-4fc9-b3cd-e6f8e64b9fff tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:36.124385 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-53c33b04-4af4-4fc9-b3cd-e6f8e64b9fff tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:36.124809 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-53c33b04-4af4-4fc9-b3cd-e6f8e64b9fff tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:36.125491 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-53c33b04-4af4-4fc9-b3cd-e6f8e64b9fff tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:36.125983 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-53c33b04-4af4-4fc9-b3cd-e6f8e64b9fff tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:36.126400 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-53c33b04-4af4-4fc9-b3cd-e6f8e64b9fff tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:36.172489 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-8de47fa1-9de3-4695-acbe-1b3288385138 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:36.180793 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-8de47fa1-9de3-4695-acbe-1b3288385138 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:36.182480 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-8de47fa1-9de3-4695-acbe-1b3288385138 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:36.183595 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-8de47fa1-9de3-4695-acbe-1b3288385138 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1405 microversion: 2.20 time: 0.157942 Aug 09 18:49:36.188031 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 61/123] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:49:36 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:49:36.268546 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-53c33b04-4af4-4fc9-b3cd-e6f8e64b9fff tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:36.273896 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-29f11b3d-d799-42c6-9f83-5afd9750c0d8 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:36.274906 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-29f11b3d-d799-42c6-9f83-5afd9750c0d8 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] [instance: 5471fc9e-e776-43fb-b11d-a617257a4a29] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:36.277846 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-53c33b04-4af4-4fc9-b3cd-e6f8e64b9fff tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1322 microversion: 2.1 time: 0.164706 Aug 09 18:49:36.278553 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 63/124] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:36 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:49:36.282074 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-29f11b3d-d799-42c6-9f83-5afd9750c0d8 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:36.283331 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-29f11b3d-d799-42c6-9f83-5afd9750c0d8 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:36.283758 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-29f11b3d-d799-42c6-9f83-5afd9750c0d8 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:36.284441 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-29f11b3d-d799-42c6-9f83-5afd9750c0d8 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:36.284884 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-29f11b3d-d799-42c6-9f83-5afd9750c0d8 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:36.285297 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-29f11b3d-d799-42c6-9f83-5afd9750c0d8 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:36.303529 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=100 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:49:36.429881 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-29f11b3d-d799-42c6-9f83-5afd9750c0d8 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde48fb289b4c7591658e27ce5ff55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539b956efa1b47799514fbdcac7e250c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:36.438587 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-29f11b3d-d799-42c6-9f83-5afd9750c0d8 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] 10.222.0.57 "GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29" status: 200 len: 1314 microversion: 2.1 time: 0.169170 Aug 09 18:49:36.439609 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 62/125] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:36 2022] GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:36.999420 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-aa7220cc-1a40-4279-832b-57da58995008 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:37.000685 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-aa7220cc-1a40-4279-832b-57da58995008 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:37.007626 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-aa7220cc-1a40-4279-832b-57da58995008 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:37.008312 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-aa7220cc-1a40-4279-832b-57da58995008 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:37.008832 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-aa7220cc-1a40-4279-832b-57da58995008 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:37.009777 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-aa7220cc-1a40-4279-832b-57da58995008 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:37.010364 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-aa7220cc-1a40-4279-832b-57da58995008 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:37.010931 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-aa7220cc-1a40-4279-832b-57da58995008 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:37.149116 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-5ce6c724-d593-4345-ab45-02f58a97f9ea req-d11eb34e-1e85-42e6-83f3-c334c22d7f8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec125ee9-c66e-4b3d-9304-ef14211241af", "name": "network-vif-plugged", "status": "completed", "tag": "f7d1b72c-d7d1-4e45-9a4e-25f70614c7cf"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:49:37.150586 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-aa7220cc-1a40-4279-832b-57da58995008 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:37.158849 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-aa7220cc-1a40-4279-832b-57da58995008 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1363 microversion: 2.1 time: 0.164149 Aug 09 18:49:37.159387 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-5ce6c724-d593-4345-ab45-02f58a97f9ea req-d11eb34e-1e85-42e6-83f3-c334c22d7f8e service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:37.159735 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 64/126] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:36 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:37.161255 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-5ce6c724-d593-4345-ab45-02f58a97f9ea req-d11eb34e-1e85-42e6-83f3-c334c22d7f8e service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:37.161902 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-5ce6c724-d593-4345-ab45-02f58a97f9ea req-d11eb34e-1e85-42e6-83f3-c334c22d7f8e service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:37.177507 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-5ce6c724-d593-4345-ab45-02f58a97f9ea req-d11eb34e-1e85-42e6-83f3-c334c22d7f8e service nova] Creating event network-vif-plugged:f7d1b72c-d7d1-4e45-9a4e-25f70614c7cf for instance ec125ee9-c66e-4b3d-9304-ef14211241af on hv-cinder-82660 Aug 09 18:49:37.183839 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-5ce6c724-d593-4345-ab45-02f58a97f9ea req-d11eb34e-1e85-42e6-83f3-c334c22d7f8e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038011 Aug 09 18:49:37.184451 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 63/127] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:49:37.207386 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-0dcc0f7f-beaf-49f7-add8-ab29cd4c14d0 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:37.210924 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-0dcc0f7f-beaf-49f7-add8-ab29cd4c14d0 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:37.216463 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0dcc0f7f-beaf-49f7-add8-ab29cd4c14d0 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:37.217028 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0dcc0f7f-beaf-49f7-add8-ab29cd4c14d0 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:37.217554 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0dcc0f7f-beaf-49f7-add8-ab29cd4c14d0 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:37.218478 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0dcc0f7f-beaf-49f7-add8-ab29cd4c14d0 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:37.218960 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0dcc0f7f-beaf-49f7-add8-ab29cd4c14d0 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:37.219449 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0dcc0f7f-beaf-49f7-add8-ab29cd4c14d0 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:37.300529 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f6ce711c-1865-4134-894e-168bc004cfd2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:37.301216 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-f6ce711c-1865-4134-894e-168bc004cfd2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:37.308470 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f6ce711c-1865-4134-894e-168bc004cfd2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:37.309049 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f6ce711c-1865-4134-894e-168bc004cfd2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:37.309574 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f6ce711c-1865-4134-894e-168bc004cfd2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:37.310279 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f6ce711c-1865-4134-894e-168bc004cfd2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:37.310735 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f6ce711c-1865-4134-894e-168bc004cfd2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:37.311159 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f6ce711c-1865-4134-894e-168bc004cfd2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:37.437654 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-0dcc0f7f-beaf-49f7-add8-ab29cd4c14d0 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:37.446719 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-0dcc0f7f-beaf-49f7-add8-ab29cd4c14d0 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:37.448496 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-0dcc0f7f-beaf-49f7-add8-ab29cd4c14d0 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:37.449868 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-0dcc0f7f-beaf-49f7-add8-ab29cd4c14d0 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1405 microversion: 2.20 time: 0.247357 Aug 09 18:49:37.465660 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 65/128] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:49:37 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1405 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:49:37.471179 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-4720f385-5982-47e2-9c1e-a99331f0ff4b tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:37.471804 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-4720f385-5982-47e2-9c1e-a99331f0ff4b tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] [instance: 5471fc9e-e776-43fb-b11d-a617257a4a29] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:37.479907 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f6ce711c-1865-4134-894e-168bc004cfd2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:37.480033 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4720f385-5982-47e2-9c1e-a99331f0ff4b tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:37.480033 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4720f385-5982-47e2-9c1e-a99331f0ff4b tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:37.480033 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4720f385-5982-47e2-9c1e-a99331f0ff4b tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:37.480033 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4720f385-5982-47e2-9c1e-a99331f0ff4b tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:37.480318 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4720f385-5982-47e2-9c1e-a99331f0ff4b tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:37.480682 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4720f385-5982-47e2-9c1e-a99331f0ff4b tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:37.485152 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f6ce711c-1865-4134-894e-168bc004cfd2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1322 microversion: 2.1 time: 0.189295 Aug 09 18:49:37.486093 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 64/129] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:37 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:49:37.669428 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-4720f385-5982-47e2-9c1e-a99331f0ff4b tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde48fb289b4c7591658e27ce5ff55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539b956efa1b47799514fbdcac7e250c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:37.673600 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell1:SELECT=100 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:49:37.678967 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-4720f385-5982-47e2-9c1e-a99331f0ff4b tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] 10.222.0.57 "GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29" status: 200 len: 1314 microversion: 2.1 time: 0.211168 Aug 09 18:49:37.685625 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 66/130] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:37 2022] GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:38.180534 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-3df185c9-024f-4d68-a0dd-e4cf999b66b3 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:38.181116 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-3df185c9-024f-4d68-a0dd-e4cf999b66b3 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:38.187282 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3df185c9-024f-4d68-a0dd-e4cf999b66b3 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:38.187755 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3df185c9-024f-4d68-a0dd-e4cf999b66b3 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:38.188180 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3df185c9-024f-4d68-a0dd-e4cf999b66b3 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:38.188911 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3df185c9-024f-4d68-a0dd-e4cf999b66b3 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:38.189355 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3df185c9-024f-4d68-a0dd-e4cf999b66b3 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:38.189824 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3df185c9-024f-4d68-a0dd-e4cf999b66b3 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:38.385706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-3df185c9-024f-4d68-a0dd-e4cf999b66b3 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:38.394792 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-3df185c9-024f-4d68-a0dd-e4cf999b66b3 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1363 microversion: 2.1 time: 0.217884 Aug 09 18:49:38.395331 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 65/131] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:38 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:38.479253 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-28c2549f-6b05-4d84-95f5-1296fb5934ea tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:38.480176 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-28c2549f-6b05-4d84-95f5-1296fb5934ea tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:38.493733 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-28c2549f-6b05-4d84-95f5-1296fb5934ea tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:38.493733 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-28c2549f-6b05-4d84-95f5-1296fb5934ea tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:38.493733 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-28c2549f-6b05-4d84-95f5-1296fb5934ea tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:38.493733 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-28c2549f-6b05-4d84-95f5-1296fb5934ea tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:38.494050 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-28c2549f-6b05-4d84-95f5-1296fb5934ea tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:38.494050 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-28c2549f-6b05-4d84-95f5-1296fb5934ea tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:38.507630 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-395397ae-9bd6-45b3-b496-a647bd045ee5 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:38.508314 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-395397ae-9bd6-45b3-b496-a647bd045ee5 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:38.520241 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-395397ae-9bd6-45b3-b496-a647bd045ee5 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:38.520831 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-395397ae-9bd6-45b3-b496-a647bd045ee5 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:38.521284 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-395397ae-9bd6-45b3-b496-a647bd045ee5 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:38.522018 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-395397ae-9bd6-45b3-b496-a647bd045ee5 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:38.522471 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-395397ae-9bd6-45b3-b496-a647bd045ee5 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:38.522896 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-395397ae-9bd6-45b3-b496-a647bd045ee5 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:38.684472 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-28c2549f-6b05-4d84-95f5-1296fb5934ea tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:38.719195 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-28c2549f-6b05-4d84-95f5-1296fb5934ea tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:38.719195 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-28c2549f-6b05-4d84-95f5-1296fb5934ea tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:38.721792 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-28c2549f-6b05-4d84-95f5-1296fb5934ea tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1405 microversion: 2.20 time: 0.248060 Aug 09 18:49:38.733548 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 67/132] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:49:38 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1405 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:49:38.733548 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-5ba42a1f-36a0-4598-96ac-c498bd9e6cb2 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:38.733548 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-5ba42a1f-36a0-4598-96ac-c498bd9e6cb2 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] [instance: 5471fc9e-e776-43fb-b11d-a617257a4a29] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:38.736177 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5ba42a1f-36a0-4598-96ac-c498bd9e6cb2 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:38.736947 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5ba42a1f-36a0-4598-96ac-c498bd9e6cb2 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:38.737307 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5ba42a1f-36a0-4598-96ac-c498bd9e6cb2 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:38.738596 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5ba42a1f-36a0-4598-96ac-c498bd9e6cb2 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:38.738966 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5ba42a1f-36a0-4598-96ac-c498bd9e6cb2 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:38.739443 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5ba42a1f-36a0-4598-96ac-c498bd9e6cb2 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:38.775284 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-395397ae-9bd6-45b3-b496-a647bd045ee5 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:38.783081 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-395397ae-9bd6-45b3-b496-a647bd045ee5 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1322 microversion: 2.1 time: 0.280953 Aug 09 18:49:38.783679 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 66/133] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:38 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1322 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:49:38.914067 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-5ba42a1f-36a0-4598-96ac-c498bd9e6cb2 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde48fb289b4c7591658e27ce5ff55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539b956efa1b47799514fbdcac7e250c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:38.921552 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-5ba42a1f-36a0-4598-96ac-c498bd9e6cb2 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] 10.222.0.57 "GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29" status: 200 len: 1314 microversion: 2.1 time: 0.197596 Aug 09 18:49:38.922211 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 68/134] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:38 2022] GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:39.416580 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-92df6922-dbec-420a-9160-610f5e70e8f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:39.417328 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-92df6922-dbec-420a-9160-610f5e70e8f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:39.423466 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-92df6922-dbec-420a-9160-610f5e70e8f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:39.423952 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-92df6922-dbec-420a-9160-610f5e70e8f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:39.424383 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-92df6922-dbec-420a-9160-610f5e70e8f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:39.425343 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-92df6922-dbec-420a-9160-610f5e70e8f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:39.425826 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-92df6922-dbec-420a-9160-610f5e70e8f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:39.431277 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-92df6922-dbec-420a-9160-610f5e70e8f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:39.531114 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-150b1555-c3e7-49e5-a41d-5218928ca488 req-d914cb75-d433-4058-8088-07553fbdfdb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22aac118-db08-4aca-a5e7-3f2cad5e49fd", "name": "network-vif-plugged", "status": "completed", "tag": "7a0b7c9e-84bf-4317-b8ea-f03780b0d3b2"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:49:39.558250 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-150b1555-c3e7-49e5-a41d-5218928ca488 req-d914cb75-d433-4058-8088-07553fbdfdb0 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:39.558250 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-150b1555-c3e7-49e5-a41d-5218928ca488 req-d914cb75-d433-4058-8088-07553fbdfdb0 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:39.558250 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-150b1555-c3e7-49e5-a41d-5218928ca488 req-d914cb75-d433-4058-8088-07553fbdfdb0 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:39.573433 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-150b1555-c3e7-49e5-a41d-5218928ca488 req-d914cb75-d433-4058-8088-07553fbdfdb0 service nova] Creating event network-vif-plugged:7a0b7c9e-84bf-4317-b8ea-f03780b0d3b2 for instance 22aac118-db08-4aca-a5e7-3f2cad5e49fd on hv-cinder-82660 Aug 09 18:49:39.581722 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-150b1555-c3e7-49e5-a41d-5218928ca488 req-d914cb75-d433-4058-8088-07553fbdfdb0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054938 Aug 09 18:49:39.585788 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 69/135] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:49:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:49:39.611127 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-92df6922-dbec-420a-9160-610f5e70e8f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:39.620672 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-92df6922-dbec-420a-9160-610f5e70e8f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1363 microversion: 2.1 time: 0.207825 Aug 09 18:49:39.621329 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 67/136] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:39 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1363 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:39.752530 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-0514f7ea-d618-4ca3-a6a1-235237aa5304 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:39.753277 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-0514f7ea-d618-4ca3-a6a1-235237aa5304 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:39.768850 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0514f7ea-d618-4ca3-a6a1-235237aa5304 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:39.769704 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0514f7ea-d618-4ca3-a6a1-235237aa5304 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:39.770650 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0514f7ea-d618-4ca3-a6a1-235237aa5304 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:39.772657 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0514f7ea-d618-4ca3-a6a1-235237aa5304 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:39.773876 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0514f7ea-d618-4ca3-a6a1-235237aa5304 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:39.774531 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0514f7ea-d618-4ca3-a6a1-235237aa5304 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:39.804639 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-83e0e89f-2571-4d3d-81a0-ed323f874ea6 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:39.805253 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-83e0e89f-2571-4d3d-81a0-ed323f874ea6 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:39.815350 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-83e0e89f-2571-4d3d-81a0-ed323f874ea6 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:39.816598 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-83e0e89f-2571-4d3d-81a0-ed323f874ea6 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:39.817059 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-83e0e89f-2571-4d3d-81a0-ed323f874ea6 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:39.817788 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-83e0e89f-2571-4d3d-81a0-ed323f874ea6 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:39.818405 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-83e0e89f-2571-4d3d-81a0-ed323f874ea6 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:39.818917 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-83e0e89f-2571-4d3d-81a0-ed323f874ea6 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:39.948557 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-0514f7ea-d618-4ca3-a6a1-235237aa5304 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:39.960088 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-0514f7ea-d618-4ca3-a6a1-235237aa5304 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:39.961849 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-0514f7ea-d618-4ca3-a6a1-235237aa5304 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:39.964192 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-0514f7ea-d618-4ca3-a6a1-235237aa5304 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1405 microversion: 2.20 time: 0.219743 Aug 09 18:49:39.965925 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 70/137] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:49:39 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1405 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:49:39.971747 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-030c5fae-8f9b-4346-8735-50bfc5f4f41f tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:39.973773 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-030c5fae-8f9b-4346-8735-50bfc5f4f41f tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] [instance: 5471fc9e-e776-43fb-b11d-a617257a4a29] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:39.979096 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-030c5fae-8f9b-4346-8735-50bfc5f4f41f tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:39.979585 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-030c5fae-8f9b-4346-8735-50bfc5f4f41f tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:39.980018 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-030c5fae-8f9b-4346-8735-50bfc5f4f41f tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:39.981158 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-030c5fae-8f9b-4346-8735-50bfc5f4f41f tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:39.981382 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-030c5fae-8f9b-4346-8735-50bfc5f4f41f tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:39.985005 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-030c5fae-8f9b-4346-8735-50bfc5f4f41f tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:40.058081 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-83e0e89f-2571-4d3d-81a0-ed323f874ea6 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:40.066726 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-83e0e89f-2571-4d3d-81a0-ed323f874ea6 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1322 microversion: 2.1 time: 0.266066 Aug 09 18:49:40.068175 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 68/138] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:39 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1322 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:40.171485 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-030c5fae-8f9b-4346-8735-50bfc5f4f41f tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde48fb289b4c7591658e27ce5ff55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539b956efa1b47799514fbdcac7e250c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:40.179934 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-030c5fae-8f9b-4346-8735-50bfc5f4f41f tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] 10.222.0.57 "GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29" status: 200 len: 1502 microversion: 2.1 time: 0.212612 Aug 09 18:49:40.180581 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 71/139] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:39 2022] GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29 => generated 1502 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:40.643104 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-152338ea-9047-476c-9353-59afd31d9223 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:40.643716 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-152338ea-9047-476c-9353-59afd31d9223 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:40.649605 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-152338ea-9047-476c-9353-59afd31d9223 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:40.650091 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-152338ea-9047-476c-9353-59afd31d9223 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:40.650514 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-152338ea-9047-476c-9353-59afd31d9223 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:40.651518 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-152338ea-9047-476c-9353-59afd31d9223 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:40.651748 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-152338ea-9047-476c-9353-59afd31d9223 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:40.652189 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-152338ea-9047-476c-9353-59afd31d9223 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:40.819934 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-152338ea-9047-476c-9353-59afd31d9223 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:40.830573 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-152338ea-9047-476c-9353-59afd31d9223 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1548 microversion: 2.1 time: 0.191769 Aug 09 18:49:40.831528 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 69/140] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:40 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1548 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:40.853476 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-5ba8385c-fcc3-4e59-8428-51bf9d166fa5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:40.854181 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-5ba8385c-fcc3-4e59-8428-51bf9d166fa5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:40.861680 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5ba8385c-fcc3-4e59-8428-51bf9d166fa5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:40.861680 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5ba8385c-fcc3-4e59-8428-51bf9d166fa5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:40.862834 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5ba8385c-fcc3-4e59-8428-51bf9d166fa5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:40.862834 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5ba8385c-fcc3-4e59-8428-51bf9d166fa5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:40.863252 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5ba8385c-fcc3-4e59-8428-51bf9d166fa5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:40.863669 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5ba8385c-fcc3-4e59-8428-51bf9d166fa5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:40.992716 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-8077dc1c-df15-4746-a596-6c14e8c23142 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:40.993328 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-8077dc1c-df15-4746-a596-6c14e8c23142 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:40.997963 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-5ba8385c-fcc3-4e59-8428-51bf9d166fa5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.148168 Aug 09 18:49:40.998571 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 72/141] 10.222.0.57 () {58 vars in 1275 bytes} [Tue Aug 9 18:49:40 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af/os-interface => generated 284 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:49:41.008622 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8077dc1c-df15-4746-a596-6c14e8c23142 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:41.018873 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8077dc1c-df15-4746-a596-6c14e8c23142 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:41.018873 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8077dc1c-df15-4746-a596-6c14e8c23142 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:41.018873 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8077dc1c-df15-4746-a596-6c14e8c23142 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:41.018873 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8077dc1c-df15-4746-a596-6c14e8c23142 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:41.019341 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8077dc1c-df15-4746-a596-6c14e8c23142 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:41.090688 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-89d448e6-33af-4ddf-87c8-4a69daafb9df tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:41.091690 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-89d448e6-33af-4ddf-87c8-4a69daafb9df tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:41.099329 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-89d448e6-33af-4ddf-87c8-4a69daafb9df tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:41.100675 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-89d448e6-33af-4ddf-87c8-4a69daafb9df tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:41.101686 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-89d448e6-33af-4ddf-87c8-4a69daafb9df tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:41.102695 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-89d448e6-33af-4ddf-87c8-4a69daafb9df tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:41.103354 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-89d448e6-33af-4ddf-87c8-4a69daafb9df tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:41.104346 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-89d448e6-33af-4ddf-87c8-4a69daafb9df tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:41.185017 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-8077dc1c-df15-4746-a596-6c14e8c23142 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:41.195716 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-8077dc1c-df15-4746-a596-6c14e8c23142 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:41.197580 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-8077dc1c-df15-4746-a596-6c14e8c23142 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:41.198908 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-8077dc1c-df15-4746-a596-6c14e8c23142 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1405 microversion: 2.20 time: 0.210738 Aug 09 18:49:41.201693 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 70/142] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:49:40 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1405 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:49:41.483312 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-89d448e6-33af-4ddf-87c8-4a69daafb9df tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:41.493125 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-89d448e6-33af-4ddf-87c8-4a69daafb9df tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1322 microversion: 2.1 time: 0.407262 Aug 09 18:49:41.493880 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 73/143] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:41 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1322 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:41.600026 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-ca0acec3-4242-405b-b698-f2310b34d23b req-49de7994-2e60-46fe-8f0a-c61d4c2b487d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9ba973a-a274-418c-aa03-1f22b8bd8b37", "name": "network-vif-plugged", "status": "completed", "tag": "eff4b1ff-04ab-46a2-a8e4-5d8ff9b6e64a"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:49:41.611281 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-ca0acec3-4242-405b-b698-f2310b34d23b req-49de7994-2e60-46fe-8f0a-c61d4c2b487d service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:41.611787 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-ca0acec3-4242-405b-b698-f2310b34d23b req-49de7994-2e60-46fe-8f0a-c61d4c2b487d service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:41.612270 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-ca0acec3-4242-405b-b698-f2310b34d23b req-49de7994-2e60-46fe-8f0a-c61d4c2b487d service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:41.624648 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-ca0acec3-4242-405b-b698-f2310b34d23b req-49de7994-2e60-46fe-8f0a-c61d4c2b487d service nova] Creating event network-vif-plugged:eff4b1ff-04ab-46a2-a8e4-5d8ff9b6e64a for instance d9ba973a-a274-418c-aa03-1f22b8bd8b37 on hv-cinder-82660 Aug 09 18:49:41.638901 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-ca0acec3-4242-405b-b698-f2310b34d23b req-49de7994-2e60-46fe-8f0a-c61d4c2b487d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041142 Aug 09 18:49:41.638901 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 71/144] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:49:42.223691 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-d6bc14ce-ee90-402d-9e75-e2a667074272 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:42.224305 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-d6bc14ce-ee90-402d-9e75-e2a667074272 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:42.230867 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d6bc14ce-ee90-402d-9e75-e2a667074272 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:42.231356 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d6bc14ce-ee90-402d-9e75-e2a667074272 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:42.231777 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d6bc14ce-ee90-402d-9e75-e2a667074272 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:42.232528 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d6bc14ce-ee90-402d-9e75-e2a667074272 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:42.233003 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d6bc14ce-ee90-402d-9e75-e2a667074272 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:42.233417 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d6bc14ce-ee90-402d-9e75-e2a667074272 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:42.517812 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c9bc1b80-2efa-4f2e-b459-b7df62e5d542 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:42.524574 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-c9bc1b80-2efa-4f2e-b459-b7df62e5d542 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:42.541294 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c9bc1b80-2efa-4f2e-b459-b7df62e5d542 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:42.543144 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c9bc1b80-2efa-4f2e-b459-b7df62e5d542 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:42.543808 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c9bc1b80-2efa-4f2e-b459-b7df62e5d542 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:42.544976 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c9bc1b80-2efa-4f2e-b459-b7df62e5d542 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:42.545721 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c9bc1b80-2efa-4f2e-b459-b7df62e5d542 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:42.546235 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c9bc1b80-2efa-4f2e-b459-b7df62e5d542 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:42.619778 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-d6bc14ce-ee90-402d-9e75-e2a667074272 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:42.634828 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-d6bc14ce-ee90-402d-9e75-e2a667074272 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:42.654913 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-d6bc14ce-ee90-402d-9e75-e2a667074272 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:42.656515 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-d6bc14ce-ee90-402d-9e75-e2a667074272 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1405 microversion: 2.20 time: 0.437556 Aug 09 18:49:42.669668 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 74/145] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:49:42 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1405 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:49:42.669668 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-9f957fd3-df61-4c2d-8ca7-d4c9a629bb1e tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "225036d0-3646-40ed-9cdd-d651d103c872"}} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:49:42.671027 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-9f957fd3-df61-4c2d-8ca7-d4c9a629bb1e tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] [instance: 5471fc9e-e776-43fb-b11d-a617257a4a29] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:42.680197 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9f957fd3-df61-4c2d-8ca7-d4c9a629bb1e tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:42.681013 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9f957fd3-df61-4c2d-8ca7-d4c9a629bb1e tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:42.681692 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9f957fd3-df61-4c2d-8ca7-d4c9a629bb1e tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:42.682596 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9f957fd3-df61-4c2d-8ca7-d4c9a629bb1e tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:42.683229 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9f957fd3-df61-4c2d-8ca7-d4c9a629bb1e tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:42.683853 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9f957fd3-df61-4c2d-8ca7-d4c9a629bb1e tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:42.759191 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-c9bc1b80-2efa-4f2e-b459-b7df62e5d542 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:42.773266 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-c9bc1b80-2efa-4f2e-b459-b7df62e5d542 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1322 microversion: 2.1 time: 0.259611 Aug 09 18:49:42.774785 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 72/146] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:42 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:49:43.158080 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-32cbfc7c-cc3b-48ec-ab78-08d1f1d3f898 req-6e013fe5-6ea2-4170-9069-34b4bd7eadb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec125ee9-c66e-4b3d-9304-ef14211241af", "tag": "f7d1b72c-d7d1-4e45-9a4e-25f70614c7cf"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:49:43.174025 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-32cbfc7c-cc3b-48ec-ab78-08d1f1d3f898 req-6e013fe5-6ea2-4170-9069-34b4bd7eadb7 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:43.175057 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-32cbfc7c-cc3b-48ec-ab78-08d1f1d3f898 req-6e013fe5-6ea2-4170-9069-34b4bd7eadb7 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:43.176545 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-32cbfc7c-cc3b-48ec-ab78-08d1f1d3f898 req-6e013fe5-6ea2-4170-9069-34b4bd7eadb7 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:43.192876 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-32cbfc7c-cc3b-48ec-ab78-08d1f1d3f898 req-6e013fe5-6ea2-4170-9069-34b4bd7eadb7 service nova] Creating event network-changed:f7d1b72c-d7d1-4e45-9a4e-25f70614c7cf for instance ec125ee9-c66e-4b3d-9304-ef14211241af on hv-cinder-82660 Aug 09 18:49:43.211463 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-32cbfc7c-cc3b-48ec-ab78-08d1f1d3f898 req-6e013fe5-6ea2-4170-9069-34b4bd7eadb7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045138 Aug 09 18:49:43.211463 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 73/147] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:49:43.689704 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-565f1ac8-7f28-464c-b468-3a6038e04bf1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:43.690468 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-565f1ac8-7f28-464c-b468-3a6038e04bf1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:43.693682 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=100 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:49:43.697342 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-565f1ac8-7f28-464c-b468-3a6038e04bf1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:43.697859 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-565f1ac8-7f28-464c-b468-3a6038e04bf1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:43.698302 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-565f1ac8-7f28-464c-b468-3a6038e04bf1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:43.699012 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-565f1ac8-7f28-464c-b468-3a6038e04bf1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:43.699525 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-565f1ac8-7f28-464c-b468-3a6038e04bf1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:43.699892 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-565f1ac8-7f28-464c-b468-3a6038e04bf1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:43.921559 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-565f1ac8-7f28-464c-b468-3a6038e04bf1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:43.925866 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-565f1ac8-7f28-464c-b468-3a6038e04bf1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:43.927604 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-565f1ac8-7f28-464c-b468-3a6038e04bf1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:43.929360 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-565f1ac8-7f28-464c-b468-3a6038e04bf1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1405 microversion: 2.20 time: 0.244638 Aug 09 18:49:43.930643 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 74/148] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:49:43 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1405 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:49:43.936034 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-6ae1dcdd-5de3-4209-896a-530ac69a0c92 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:43.936726 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-6ae1dcdd-5de3-4209-896a-530ac69a0c92 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:43.944068 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6ae1dcdd-5de3-4209-896a-530ac69a0c92 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:43.944736 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6ae1dcdd-5de3-4209-896a-530ac69a0c92 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:43.945375 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6ae1dcdd-5de3-4209-896a-530ac69a0c92 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:43.946490 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6ae1dcdd-5de3-4209-896a-530ac69a0c92 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:43.948185 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6ae1dcdd-5de3-4209-896a-530ac69a0c92 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:43.948921 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6ae1dcdd-5de3-4209-896a-530ac69a0c92 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:44.161114 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-6ae1dcdd-5de3-4209-896a-530ac69a0c92 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:44.169217 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-6ae1dcdd-5de3-4209-896a-530ac69a0c92 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1322 microversion: 2.1 time: 0.237276 Aug 09 18:49:44.169837 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 75/149] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:43 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:44.954381 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-8e7fb841-f41b-42aa-a62a-dbc1a4fe219c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:44.955764 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-8e7fb841-f41b-42aa-a62a-dbc1a4fe219c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:44.974629 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8e7fb841-f41b-42aa-a62a-dbc1a4fe219c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:44.975156 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8e7fb841-f41b-42aa-a62a-dbc1a4fe219c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:44.975629 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8e7fb841-f41b-42aa-a62a-dbc1a4fe219c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:44.976419 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8e7fb841-f41b-42aa-a62a-dbc1a4fe219c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:44.976878 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8e7fb841-f41b-42aa-a62a-dbc1a4fe219c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:44.977310 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8e7fb841-f41b-42aa-a62a-dbc1a4fe219c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:45.044625 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-9f957fd3-df61-4c2d-8ca7-d4c9a629bb1e tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] 10.222.0.57 "POST /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.382123 Aug 09 18:49:45.045628 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 75/150] 10.222.0.57 () {60 vars in 1323 bytes} [Tue Aug 9 18:49:42 2022] POST /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29/os-volume_attachments => generated 194 bytes in 2386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:49:45.202904 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-f52b0a9b-c830-425f-b393-85b76de9b37b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:45.205101 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-f52b0a9b-c830-425f-b393-85b76de9b37b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:45.215119 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f52b0a9b-c830-425f-b393-85b76de9b37b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:45.215992 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f52b0a9b-c830-425f-b393-85b76de9b37b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:45.216601 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f52b0a9b-c830-425f-b393-85b76de9b37b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:45.217719 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f52b0a9b-c830-425f-b393-85b76de9b37b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:45.218332 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f52b0a9b-c830-425f-b393-85b76de9b37b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:45.219126 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f52b0a9b-c830-425f-b393-85b76de9b37b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:45.352307 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-8e7fb841-f41b-42aa-a62a-dbc1a4fe219c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:45.362895 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-8e7fb841-f41b-42aa-a62a-dbc1a4fe219c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:45.366441 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-8e7fb841-f41b-42aa-a62a-dbc1a4fe219c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:45.367905 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-8e7fb841-f41b-42aa-a62a-dbc1a4fe219c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1597 microversion: 2.20 time: 0.419285 Aug 09 18:49:45.368835 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 76/151] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:49:44 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1597 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:49:45.392355 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-3d98f0fb-55e1-4802-8f53-fed02f58f9f9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:45.393131 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-3d98f0fb-55e1-4802-8f53-fed02f58f9f9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:45.400242 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3d98f0fb-55e1-4802-8f53-fed02f58f9f9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:45.400860 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3d98f0fb-55e1-4802-8f53-fed02f58f9f9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:45.401357 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3d98f0fb-55e1-4802-8f53-fed02f58f9f9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:45.402172 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3d98f0fb-55e1-4802-8f53-fed02f58f9f9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:45.402703 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3d98f0fb-55e1-4802-8f53-fed02f58f9f9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:45.403182 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3d98f0fb-55e1-4802-8f53-fed02f58f9f9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:45.523285 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-f52b0a9b-c830-425f-b393-85b76de9b37b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:45.534041 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-f52b0a9b-c830-425f-b393-85b76de9b37b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1516 microversion: 2.1 time: 0.346914 Aug 09 18:49:45.539694 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 76/152] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:45 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1516 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:45.563905 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-7939b28b-dd40-44d7-802e-259acdf1e074 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:49:45.567406 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-7939b28b-dd40-44d7-802e-259acdf1e074 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:45.578858 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7939b28b-dd40-44d7-802e-259acdf1e074 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:45.583127 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-3d98f0fb-55e1-4802-8f53-fed02f58f9f9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.194838 Aug 09 18:49:45.585014 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 77/153] 10.222.0.57 () {60 vars in 1316 bytes} [Tue Aug 9 18:49:45 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd/os-interface => generated 284 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:49:45.585709 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7939b28b-dd40-44d7-802e-259acdf1e074 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:45.586335 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7939b28b-dd40-44d7-802e-259acdf1e074 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:45.587670 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7939b28b-dd40-44d7-802e-259acdf1e074 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:45.588386 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7939b28b-dd40-44d7-802e-259acdf1e074 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:45.588815 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7939b28b-dd40-44d7-802e-259acdf1e074 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:45.626348 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.objects.instance [None req-7939b28b-dd40-44d7-802e-259acdf1e074 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lazy-loading 'flavor' on Instance uuid d9ba973a-a274-418c-aa03-1f22b8bd8b37 {{(pid=124726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:49:46.124537 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-7939b28b-dd40-44d7-802e-259acdf1e074 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "POST /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37/action" status: 200 len: 32 microversion: 2.1 time: 0.564776 Aug 09 18:49:46.130964 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 77/154] 10.222.0.57 () {60 vars in 1278 bytes} [Tue Aug 9 18:49:45 2022] POST /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37/action => generated 32 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 18:49:46.138462 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-30896f38-3fb4-4fe5-8fe5-cc94feed025c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:46.139095 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-30896f38-3fb4-4fe5-8fe5-cc94feed025c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:46.159112 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-30896f38-3fb4-4fe5-8fe5-cc94feed025c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:46.159790 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-30896f38-3fb4-4fe5-8fe5-cc94feed025c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:46.160278 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-30896f38-3fb4-4fe5-8fe5-cc94feed025c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:46.160985 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-30896f38-3fb4-4fe5-8fe5-cc94feed025c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:46.161435 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-30896f38-3fb4-4fe5-8fe5-cc94feed025c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:46.161885 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-30896f38-3fb4-4fe5-8fe5-cc94feed025c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:46.634995 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-30896f38-3fb4-4fe5-8fe5-cc94feed025c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:46.643970 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-30896f38-3fb4-4fe5-8fe5-cc94feed025c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1522 microversion: 2.1 time: 0.511156 Aug 09 18:49:46.644575 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 78/155] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:46 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1522 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:47.645361 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-f387eddd-ad0d-4600-91f1-96dfcee4af6f req-337e429d-c890-4f0d-b07d-69efa4e9b856 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22aac118-db08-4aca-a5e7-3f2cad5e49fd", "tag": "7a0b7c9e-84bf-4317-b8ea-f03780b0d3b2"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:49:47.650869 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_api:SELECT=91 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:49:47.656277 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-f387eddd-ad0d-4600-91f1-96dfcee4af6f req-337e429d-c890-4f0d-b07d-69efa4e9b856 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:47.656915 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-f387eddd-ad0d-4600-91f1-96dfcee4af6f req-337e429d-c890-4f0d-b07d-69efa4e9b856 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:47.657223 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-f387eddd-ad0d-4600-91f1-96dfcee4af6f req-337e429d-c890-4f0d-b07d-69efa4e9b856 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:47.666074 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-1710e7e1-f884-4edb-9286-49482354fa6e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:47.667497 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-1710e7e1-f884-4edb-9286-49482354fa6e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:47.668356 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-f387eddd-ad0d-4600-91f1-96dfcee4af6f req-337e429d-c890-4f0d-b07d-69efa4e9b856 service nova] Creating event network-changed:7a0b7c9e-84bf-4317-b8ea-f03780b0d3b2 for instance 22aac118-db08-4aca-a5e7-3f2cad5e49fd on hv-cinder-82660 Aug 09 18:49:47.675661 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1710e7e1-f884-4edb-9286-49482354fa6e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:47.679365 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1710e7e1-f884-4edb-9286-49482354fa6e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:47.679365 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1710e7e1-f884-4edb-9286-49482354fa6e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:47.679365 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1710e7e1-f884-4edb-9286-49482354fa6e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:47.679365 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1710e7e1-f884-4edb-9286-49482354fa6e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:47.680014 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1710e7e1-f884-4edb-9286-49482354fa6e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:47.686266 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-f387eddd-ad0d-4600-91f1-96dfcee4af6f req-337e429d-c890-4f0d-b07d-69efa4e9b856 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044059 Aug 09 18:49:47.686880 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 78/156] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:49:47.894200 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1710e7e1-f884-4edb-9286-49482354fa6e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:47.904124 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-1710e7e1-f884-4edb-9286-49482354fa6e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1522 microversion: 2.1 time: 0.243006 Aug 09 18:49:47.912285 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 79/157] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:47 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:48.928234 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-1566f8df-d320-4c6a-ae41-bf7d95f1a72a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:48.929619 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-1566f8df-d320-4c6a-ae41-bf7d95f1a72a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:48.939168 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1566f8df-d320-4c6a-ae41-bf7d95f1a72a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:48.939662 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1566f8df-d320-4c6a-ae41-bf7d95f1a72a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:48.940100 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1566f8df-d320-4c6a-ae41-bf7d95f1a72a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:48.940846 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1566f8df-d320-4c6a-ae41-bf7d95f1a72a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:48.941300 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1566f8df-d320-4c6a-ae41-bf7d95f1a72a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:48.941762 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1566f8df-d320-4c6a-ae41-bf7d95f1a72a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:49.123234 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-1566f8df-d320-4c6a-ae41-bf7d95f1a72a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:49.131914 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-1566f8df-d320-4c6a-ae41-bf7d95f1a72a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1522 microversion: 2.1 time: 0.208563 Aug 09 18:49:49.132559 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 79/158] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:48 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:50.152648 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-8671c725-dcb0-4a70-b415-9d1b149c63c1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:50.153991 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-8671c725-dcb0-4a70-b415-9d1b149c63c1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:50.161981 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8671c725-dcb0-4a70-b415-9d1b149c63c1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:50.161981 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8671c725-dcb0-4a70-b415-9d1b149c63c1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:50.161981 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8671c725-dcb0-4a70-b415-9d1b149c63c1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:50.161981 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8671c725-dcb0-4a70-b415-9d1b149c63c1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:50.162401 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8671c725-dcb0-4a70-b415-9d1b149c63c1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:50.162704 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8671c725-dcb0-4a70-b415-9d1b149c63c1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:50.336819 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-8671c725-dcb0-4a70-b415-9d1b149c63c1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:50.345799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-8671c725-dcb0-4a70-b415-9d1b149c63c1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1522 microversion: 2.1 time: 0.196863 Aug 09 18:49:50.346515 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 80/159] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:50 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:51.366555 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-96a678a0-f422-4177-bd0f-a3ad05b00202 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:51.367431 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-96a678a0-f422-4177-bd0f-a3ad05b00202 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:51.377935 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-96a678a0-f422-4177-bd0f-a3ad05b00202 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:51.378761 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-96a678a0-f422-4177-bd0f-a3ad05b00202 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:51.379372 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-96a678a0-f422-4177-bd0f-a3ad05b00202 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:51.380404 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-96a678a0-f422-4177-bd0f-a3ad05b00202 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:51.381458 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-96a678a0-f422-4177-bd0f-a3ad05b00202 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:51.384672 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-96a678a0-f422-4177-bd0f-a3ad05b00202 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:51.658377 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-96a678a0-f422-4177-bd0f-a3ad05b00202 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:51.667141 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-96a678a0-f422-4177-bd0f-a3ad05b00202 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1522 microversion: 2.1 time: 0.304254 Aug 09 18:49:51.668037 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 80/160] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:51 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:52.689952 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b9d01c35-7437-4a3f-a94b-bc47b8c8e6b5 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:52.690638 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-b9d01c35-7437-4a3f-a94b-bc47b8c8e6b5 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:52.696626 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b9d01c35-7437-4a3f-a94b-bc47b8c8e6b5 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:52.697093 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b9d01c35-7437-4a3f-a94b-bc47b8c8e6b5 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:52.697569 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b9d01c35-7437-4a3f-a94b-bc47b8c8e6b5 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:52.698246 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b9d01c35-7437-4a3f-a94b-bc47b8c8e6b5 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:52.698693 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b9d01c35-7437-4a3f-a94b-bc47b8c8e6b5 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:52.699118 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b9d01c35-7437-4a3f-a94b-bc47b8c8e6b5 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:52.720111 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=100 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:49:52.884922 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-b9d01c35-7437-4a3f-a94b-bc47b8c8e6b5 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:52.894857 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-b9d01c35-7437-4a3f-a94b-bc47b8c8e6b5 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1522 microversion: 2.1 time: 0.209246 Aug 09 18:49:52.909004 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 81/161] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:52 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:53.915355 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-f0442663-dd4b-478b-bffd-ab7d78f0a2d1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:53.916025 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-f0442663-dd4b-478b-bffd-ab7d78f0a2d1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:53.922998 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f0442663-dd4b-478b-bffd-ab7d78f0a2d1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:53.923469 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f0442663-dd4b-478b-bffd-ab7d78f0a2d1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:53.923897 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f0442663-dd4b-478b-bffd-ab7d78f0a2d1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:53.924570 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f0442663-dd4b-478b-bffd-ab7d78f0a2d1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:53.925269 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f0442663-dd4b-478b-bffd-ab7d78f0a2d1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:53.925709 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f0442663-dd4b-478b-bffd-ab7d78f0a2d1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:54.184263 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-f0442663-dd4b-478b-bffd-ab7d78f0a2d1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:54.191834 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:49:54.202275 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-f0442663-dd4b-478b-bffd-ab7d78f0a2d1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1522 microversion: 2.1 time: 0.290173 Aug 09 18:49:54.206035 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 81/162] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:53 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:55.228602 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-2a0f0ff9-67e1-4f8f-adfa-8883366d3c2a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:55.228602 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-2a0f0ff9-67e1-4f8f-adfa-8883366d3c2a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:55.232062 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2a0f0ff9-67e1-4f8f-adfa-8883366d3c2a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:55.232536 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2a0f0ff9-67e1-4f8f-adfa-8883366d3c2a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:55.232965 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2a0f0ff9-67e1-4f8f-adfa-8883366d3c2a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:55.233681 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2a0f0ff9-67e1-4f8f-adfa-8883366d3c2a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:55.234123 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2a0f0ff9-67e1-4f8f-adfa-8883366d3c2a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:55.235164 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2a0f0ff9-67e1-4f8f-adfa-8883366d3c2a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:55.400129 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-2a0f0ff9-67e1-4f8f-adfa-8883366d3c2a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:55.409780 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-2a0f0ff9-67e1-4f8f-adfa-8883366d3c2a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1522 microversion: 2.1 time: 0.189448 Aug 09 18:49:55.420022 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 82/163] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:55 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:55.967693 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-ba09d369-691d-4ddd-aee9-1d670c1046a5 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:55.968362 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-ba09d369-691d-4ddd-aee9-1d670c1046a5 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] [instance: 5471fc9e-e776-43fb-b11d-a617257a4a29] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:55.980531 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ba09d369-691d-4ddd-aee9-1d670c1046a5 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:55.981054 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ba09d369-691d-4ddd-aee9-1d670c1046a5 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:55.981496 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ba09d369-691d-4ddd-aee9-1d670c1046a5 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:55.982240 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ba09d369-691d-4ddd-aee9-1d670c1046a5 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:55.982699 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ba09d369-691d-4ddd-aee9-1d670c1046a5 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:55.985668 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ba09d369-691d-4ddd-aee9-1d670c1046a5 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:56.032656 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-ba09d369-691d-4ddd-aee9-1d670c1046a5 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] [instance: 5471fc9e-e776-43fb-b11d-a617257a4a29] Going to try to terminate instance {{(pid=124726) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:49:56.360590 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-ba09d369-691d-4ddd-aee9-1d670c1046a5 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] 10.222.0.57 "DELETE /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29" status: 204 len: 0 microversion: 2.1 time: 0.396619 Aug 09 18:49:56.361295 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 82/164] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 9 18:49:55 2022] DELETE /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:49:56.370253 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-09eabc13-eec5-4652-b00e-5373083b7fe4 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:56.371066 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-09eabc13-eec5-4652-b00e-5373083b7fe4 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] [instance: 5471fc9e-e776-43fb-b11d-a617257a4a29] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:56.377334 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-09eabc13-eec5-4652-b00e-5373083b7fe4 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:56.378021 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-09eabc13-eec5-4652-b00e-5373083b7fe4 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:56.378614 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-09eabc13-eec5-4652-b00e-5373083b7fe4 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:56.379622 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-09eabc13-eec5-4652-b00e-5373083b7fe4 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:56.380083 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-09eabc13-eec5-4652-b00e-5373083b7fe4 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:56.380508 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-09eabc13-eec5-4652-b00e-5373083b7fe4 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:56.435542 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-c168ada1-9f57-4174-9bf5-0e909af34c11 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:56.436701 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-c168ada1-9f57-4174-9bf5-0e909af34c11 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:56.443414 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c168ada1-9f57-4174-9bf5-0e909af34c11 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:56.444477 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c168ada1-9f57-4174-9bf5-0e909af34c11 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:56.445096 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c168ada1-9f57-4174-9bf5-0e909af34c11 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:56.446347 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c168ada1-9f57-4174-9bf5-0e909af34c11 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:56.446944 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c168ada1-9f57-4174-9bf5-0e909af34c11 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:56.447514 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c168ada1-9f57-4174-9bf5-0e909af34c11 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:56.573766 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-09eabc13-eec5-4652-b00e-5373083b7fe4 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde48fb289b4c7591658e27ce5ff55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539b956efa1b47799514fbdcac7e250c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:56.583244 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-09eabc13-eec5-4652-b00e-5373083b7fe4 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] 10.222.0.57 "GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29" status: 200 len: 1554 microversion: 2.1 time: 0.217351 Aug 09 18:49:56.583820 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 83/165] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:56 2022] GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29 => generated 1554 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:56.617778 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-c168ada1-9f57-4174-9bf5-0e909af34c11 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:56.631999 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-c168ada1-9f57-4174-9bf5-0e909af34c11 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1522 microversion: 2.1 time: 0.200828 Aug 09 18:49:56.634242 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 83/166] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:56 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:49:57.610288 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-1bca97ee-73ef-429b-9839-a0d80da36075 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:57.610920 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-1bca97ee-73ef-429b-9839-a0d80da36075 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] [instance: 5471fc9e-e776-43fb-b11d-a617257a4a29] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:57.617036 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1bca97ee-73ef-429b-9839-a0d80da36075 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:57.617542 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1bca97ee-73ef-429b-9839-a0d80da36075 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:57.617983 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1bca97ee-73ef-429b-9839-a0d80da36075 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:57.618703 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1bca97ee-73ef-429b-9839-a0d80da36075 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:57.619214 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1bca97ee-73ef-429b-9839-a0d80da36075 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:57.619656 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1bca97ee-73ef-429b-9839-a0d80da36075 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:57.660332 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-844f8389-83ce-458b-9c04-4c777ace5800 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:57.660947 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-844f8389-83ce-458b-9c04-4c777ace5800 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:57.667990 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-844f8389-83ce-458b-9c04-4c777ace5800 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:57.668478 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-844f8389-83ce-458b-9c04-4c777ace5800 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:57.668912 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-844f8389-83ce-458b-9c04-4c777ace5800 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:57.669649 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-844f8389-83ce-458b-9c04-4c777ace5800 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:57.670103 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-844f8389-83ce-458b-9c04-4c777ace5800 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:57.670530 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-844f8389-83ce-458b-9c04-4c777ace5800 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:57.811929 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1bca97ee-73ef-429b-9839-a0d80da36075 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde48fb289b4c7591658e27ce5ff55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539b956efa1b47799514fbdcac7e250c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:57.821259 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-1bca97ee-73ef-429b-9839-a0d80da36075 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] 10.222.0.57 "GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29" status: 200 len: 1554 microversion: 2.1 time: 0.214784 Aug 09 18:49:57.821892 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 84/167] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:57 2022] GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29 => generated 1554 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:57.848243 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-844f8389-83ce-458b-9c04-4c777ace5800 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:57.856467 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-844f8389-83ce-458b-9c04-4c777ace5800 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1522 microversion: 2.1 time: 0.199923 Aug 09 18:49:57.857045 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 84/168] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:57 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:58.844150 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-113e8ace-26cb-4844-848a-48b2de2fe67e tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:58.844776 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-113e8ace-26cb-4844-848a-48b2de2fe67e tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] [instance: 5471fc9e-e776-43fb-b11d-a617257a4a29] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:58.850927 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-113e8ace-26cb-4844-848a-48b2de2fe67e tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:58.851408 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-113e8ace-26cb-4844-848a-48b2de2fe67e tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:58.851831 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-113e8ace-26cb-4844-848a-48b2de2fe67e tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:58.852602 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-113e8ace-26cb-4844-848a-48b2de2fe67e tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:58.853052 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-113e8ace-26cb-4844-848a-48b2de2fe67e tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:58.853464 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-113e8ace-26cb-4844-848a-48b2de2fe67e tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:58.881686 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-aa58a706-5484-49ed-8817-fcd7d542ed13 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:49:58.882303 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-aa58a706-5484-49ed-8817-fcd7d542ed13 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:49:58.898935 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-aa58a706-5484-49ed-8817-fcd7d542ed13 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:58.899673 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-aa58a706-5484-49ed-8817-fcd7d542ed13 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:58.900295 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-aa58a706-5484-49ed-8817-fcd7d542ed13 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:58.901717 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-aa58a706-5484-49ed-8817-fcd7d542ed13 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:58.902374 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-aa58a706-5484-49ed-8817-fcd7d542ed13 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:58.905132 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-aa58a706-5484-49ed-8817-fcd7d542ed13 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:59.009848 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-113e8ace-26cb-4844-848a-48b2de2fe67e tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde48fb289b4c7591658e27ce5ff55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539b956efa1b47799514fbdcac7e250c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:59.019500 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-113e8ace-26cb-4844-848a-48b2de2fe67e tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] 10.222.0.57 "GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29" status: 200 len: 1554 microversion: 2.1 time: 0.179113 Aug 09 18:49:59.020415 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 85/169] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:58 2022] GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29 => generated 1554 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:59.263409 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-aa58a706-5484-49ed-8817-fcd7d542ed13 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:49:59.282740 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-aa58a706-5484-49ed-8817-fcd7d542ed13 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1522 microversion: 2.1 time: 0.408410 Aug 09 18:49:59.286291 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 85/170] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:49:58 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1522 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:49:59.737199 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-c156edcc-323f-4ce0-8f6c-7cf8ae83213d req-bc37a69e-d5c3-42ad-9bae-8226f184457f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5471fc9e-e776-43fb-b11d-a617257a4a29", "name": "network-vif-deleted", "tag": "9e855bf9-2f85-4e63-ba2b-8a8b16f67408"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:49:59.751956 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-c156edcc-323f-4ce0-8f6c-7cf8ae83213d req-bc37a69e-d5c3-42ad-9bae-8226f184457f service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:49:59.757999 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-c156edcc-323f-4ce0-8f6c-7cf8ae83213d req-bc37a69e-d5c3-42ad-9bae-8226f184457f service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:49:59.758508 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-c156edcc-323f-4ce0-8f6c-7cf8ae83213d req-bc37a69e-d5c3-42ad-9bae-8226f184457f service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:49:59.773534 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-c156edcc-323f-4ce0-8f6c-7cf8ae83213d req-bc37a69e-d5c3-42ad-9bae-8226f184457f service nova] Creating event network-vif-deleted:9e855bf9-2f85-4e63-ba2b-8a8b16f67408 for instance 5471fc9e-e776-43fb-b11d-a617257a4a29 on hv-cinder-82660 Aug 09 18:49:59.783640 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-c156edcc-323f-4ce0-8f6c-7cf8ae83213d req-bc37a69e-d5c3-42ad-9bae-8226f184457f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050531 Aug 09 18:49:59.784760 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 86/171] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:50:00.040189 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-b75c8146-3f9f-489b-b6ad-7c79349d8855 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:00.040805 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-b75c8146-3f9f-489b-b6ad-7c79349d8855 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] [instance: 5471fc9e-e776-43fb-b11d-a617257a4a29] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:00.047637 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b75c8146-3f9f-489b-b6ad-7c79349d8855 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:00.048165 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b75c8146-3f9f-489b-b6ad-7c79349d8855 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:00.048933 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b75c8146-3f9f-489b-b6ad-7c79349d8855 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:00.050201 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b75c8146-3f9f-489b-b6ad-7c79349d8855 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:00.050829 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b75c8146-3f9f-489b-b6ad-7c79349d8855 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:00.051453 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b75c8146-3f9f-489b-b6ad-7c79349d8855 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:00.125324 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-b75c8146-3f9f-489b-b6ad-7c79349d8855 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde48fb289b4c7591658e27ce5ff55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539b956efa1b47799514fbdcac7e250c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:00.135221 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-b75c8146-3f9f-489b-b6ad-7c79349d8855 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] 10.222.0.57 "GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29" status: 200 len: 1345 microversion: 2.1 time: 0.098610 Aug 09 18:50:00.135850 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 86/172] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:00 2022] GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29 => generated 1345 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:00.317906 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d8e078ae-2acc-4f78-aab1-b1126110b3a1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:00.324154 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-d8e078ae-2acc-4f78-aab1-b1126110b3a1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:00.349420 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d8e078ae-2acc-4f78-aab1-b1126110b3a1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:00.349953 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d8e078ae-2acc-4f78-aab1-b1126110b3a1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:00.350391 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d8e078ae-2acc-4f78-aab1-b1126110b3a1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:00.351356 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d8e078ae-2acc-4f78-aab1-b1126110b3a1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:00.351888 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d8e078ae-2acc-4f78-aab1-b1126110b3a1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:00.352315 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d8e078ae-2acc-4f78-aab1-b1126110b3a1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:00.636849 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d8e078ae-2acc-4f78-aab1-b1126110b3a1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:00.646045 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-d8e078ae-2acc-4f78-aab1-b1126110b3a1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1522 microversion: 2.1 time: 0.343280 Aug 09 18:50:00.658345 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 87/173] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:00 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1522 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:01.157247 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-586c3e82-5f13-43b2-88ae-688d6535a986 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:01.158855 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-586c3e82-5f13-43b2-88ae-688d6535a986 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] [instance: 5471fc9e-e776-43fb-b11d-a617257a4a29] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:01.165499 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-586c3e82-5f13-43b2-88ae-688d6535a986 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:01.174492 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-586c3e82-5f13-43b2-88ae-688d6535a986 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:01.174492 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-586c3e82-5f13-43b2-88ae-688d6535a986 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:01.174492 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-586c3e82-5f13-43b2-88ae-688d6535a986 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:01.174492 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-586c3e82-5f13-43b2-88ae-688d6535a986 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:01.175492 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-586c3e82-5f13-43b2-88ae-688d6535a986 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:01.204913 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-586c3e82-5f13-43b2-88ae-688d6535a986 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:01.205433 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-586c3e82-5f13-43b2-88ae-688d6535a986 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:01.205865 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-586c3e82-5f13-43b2-88ae-688d6535a986 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:01.206312 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.objects.instance [None req-586c3e82-5f13-43b2-88ae-688d6535a986 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lazy-loading 'fault' on Instance uuid 5471fc9e-e776-43fb-b11d-a617257a4a29 {{(pid=124726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:50:01.267915 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-586c3e82-5f13-43b2-88ae-688d6535a986 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde48fb289b4c7591658e27ce5ff55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539b956efa1b47799514fbdcac7e250c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:01.277735 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-586c3e82-5f13-43b2-88ae-688d6535a986 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] 10.222.0.57 "GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29" status: 200 len: 1350 microversion: 2.1 time: 0.124650 Aug 09 18:50:01.278940 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 87/174] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:01 2022] GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29 => generated 1350 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:01.667606 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-64355c53-3ff1-4fd9-a665-3dfcd3320c79 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:01.668204 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-64355c53-3ff1-4fd9-a665-3dfcd3320c79 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:01.675635 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-64355c53-3ff1-4fd9-a665-3dfcd3320c79 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:01.676121 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-64355c53-3ff1-4fd9-a665-3dfcd3320c79 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:01.676544 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-64355c53-3ff1-4fd9-a665-3dfcd3320c79 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:01.677231 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-64355c53-3ff1-4fd9-a665-3dfcd3320c79 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:01.677701 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-64355c53-3ff1-4fd9-a665-3dfcd3320c79 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:01.678123 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-64355c53-3ff1-4fd9-a665-3dfcd3320c79 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:01.827284 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-64355c53-3ff1-4fd9-a665-3dfcd3320c79 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:01.836122 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-64355c53-3ff1-4fd9-a665-3dfcd3320c79 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1522 microversion: 2.1 time: 0.172200 Aug 09 18:50:01.837038 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 88/175] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:01 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:02.304048 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-b1c21290-ee2e-4aa2-95c8-be11b7206751 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:02.304735 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-b1c21290-ee2e-4aa2-95c8-be11b7206751 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] [instance: 5471fc9e-e776-43fb-b11d-a617257a4a29] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:02.311282 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b1c21290-ee2e-4aa2-95c8-be11b7206751 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:02.311764 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b1c21290-ee2e-4aa2-95c8-be11b7206751 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:02.312736 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b1c21290-ee2e-4aa2-95c8-be11b7206751 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:02.313445 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b1c21290-ee2e-4aa2-95c8-be11b7206751 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:02.313954 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b1c21290-ee2e-4aa2-95c8-be11b7206751 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:02.314370 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b1c21290-ee2e-4aa2-95c8-be11b7206751 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:02.329957 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.wsgi [None req-b1c21290-ee2e-4aa2-95c8-be11b7206751 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] HTTP exception thrown: Instance 5471fc9e-e776-43fb-b11d-a617257a4a29 could not be found. Aug 09 18:50:02.344306 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-b1c21290-ee2e-4aa2-95c8-be11b7206751 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Request method failure captured: Aug 09 18:50:02.344306 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: request: GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29 HTTP/1.1 Aug 09 18:50:02.344306 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept: application/json Aug 09 18:50:02.344306 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept-Encoding: identity Aug 09 18:50:02.344306 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Connection: close Aug 09 18:50:02.344306 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Length: 0 Aug 09 18:50:02.344306 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Type: application/json Aug 09 18:50:02.344306 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Host: 10.222.0.57 Aug 09 18:50:02.344306 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Openstack-System-Scope: None Aug 09 18:50:02.344306 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: User-Agent: python-urllib3/1.26.11 Aug 09 18:50:02.344306 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Auth-Token: gAAAAABi8qwXoWpOCmHCs_0uoJfaFQBn3SVYEJBM9HTHYwwjKEwIQIXvWTkdP7f_WIQTSFmpkAsD3d0HCcBIY5ObkfwhcWqrwjjlL2lXvipjstWXXlIqoMot28H7RA0Dvczr2B1Miu3XaIb1zFhdun4LK06dLazuio_b45OwU22SY6M0qTbMgeA Aug 09 18:50:02.344306 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Id: None Aug 09 18:50:02.344306 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Name: None Aug 09 18:50:02.344306 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Identity-Status: Confirmed Aug 09 18:50:02.344306 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Is-Admin-Project: True Aug 09 18:50:02.344306 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Id: default Aug 09 18:50:02.344306 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Name: Default Aug 09 18:50:02.344306 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Id: 539b956efa1b47799514fbdcac7e250c Aug 09 18:50:02.344306 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Name: tempest-DeleteServersTestJSON-1912590532 Aug 09 18:50:02.344306 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Role: reader,member Aug 09 18:50:02.344306 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Roles: reader,member Aug 09 18:50:02.345868 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_539b956efa1b47799514fbdcac7e250c", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/539b956efa1b47799514fbdcac7e250c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/539b956efa1b47799514fbdcac7e250c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/539b956efa1b47799514fbdcac7e250c"}]}] Aug 09 18:50:02.345868 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant: tempest-DeleteServersTestJSON-1912590532 Aug 09 18:50:02.345868 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Id: 539b956efa1b47799514fbdcac7e250c Aug 09 18:50:02.345868 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Name: tempest-DeleteServersTestJSON-1912590532 Aug 09 18:50:02.345868 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User: tempest-DeleteServersTestJSON-1912590532-project Aug 09 18:50:02.345868 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Id: default Aug 09 18:50:02.345868 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Name: Default Aug 09 18:50:02.345868 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Id: 7fde48fb289b4c7591658e27ce5ff55e Aug 09 18:50:02.345868 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Name: tempest-DeleteServersTestJSON-1912590532-project Aug 09 18:50:02.345868 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: method: > Aug 09 18:50:02.345868 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: exception: Instance 5471fc9e-e776-43fb-b11d-a617257a4a29 could not be found. Aug 09 18:50:02.345868 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: action_args: {'id': '5471fc9e-e776-43fb-b11d-a617257a4a29'} Aug 09 18:50:02.346662 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:50:02.346662 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:50:02.346662 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:50:02.346662 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:50:02.346662 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:50:02.346662 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:50:02.346662 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:50:02.346662 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:50:02.346662 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:50:02.346662 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:50:02.346662 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5471fc9e-e776-43fb-b11d-a617257a4a29 could not be found. Aug 09 18:50:02.346662 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:50:02.346662 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:50:02.346662 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:50:02.346662 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:50:02.346662 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:50:02.346662 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:50:02.346662 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:50:02.346662 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:50:02.346662 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:50:02.348283 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:50:02.348283 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:50:02.348283 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:50:02.348283 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:50:02.348283 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:50:02.348283 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:50:02.348283 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:50:02.348283 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5471fc9e-e776-43fb-b11d-a617257a4a29 could not be found. Aug 09 18:50:02.348283 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:50:02.348283 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:50:02.348283 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:50:02.348283 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:50:02.348283 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:50:02.348283 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:50:02.348283 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:50:02.348283 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:50:02.348283 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5471fc9e-e776-43fb-b11d-a617257a4a29 could not be found. Aug 09 18:50:02.348283 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:50:02.349906 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-b1c21290-ee2e-4aa2-95c8-be11b7206751 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Returning 404 to user: Instance 5471fc9e-e776-43fb-b11d-a617257a4a29 could not be found. {{(pid=124726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:50:02.349906 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-b1c21290-ee2e-4aa2-95c8-be11b7206751 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] 10.222.0.57 "GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29" status: 404 len: 111 microversion: 2.1 time: 0.046060 Aug 09 18:50:02.349906 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 88/176] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:02 2022] GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:50:02.857825 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-19030b05-8dc0-4671-99b1-23df99f03c43 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:02.858374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-19030b05-8dc0-4671-99b1-23df99f03c43 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:02.865047 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-19030b05-8dc0-4671-99b1-23df99f03c43 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:02.865551 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-19030b05-8dc0-4671-99b1-23df99f03c43 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:02.865999 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-19030b05-8dc0-4671-99b1-23df99f03c43 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:02.866695 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-19030b05-8dc0-4671-99b1-23df99f03c43 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:02.867150 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-19030b05-8dc0-4671-99b1-23df99f03c43 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:02.867575 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-19030b05-8dc0-4671-99b1-23df99f03c43 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:03.009863 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-d98959da-f46c-4b99-a97c-52143eaab56f tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:03.013548 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-d98959da-f46c-4b99-a97c-52143eaab56f tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] [instance: 5471fc9e-e776-43fb-b11d-a617257a4a29] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:03.019803 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d98959da-f46c-4b99-a97c-52143eaab56f tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:03.020641 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d98959da-f46c-4b99-a97c-52143eaab56f tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:03.021287 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d98959da-f46c-4b99-a97c-52143eaab56f tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:03.022433 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d98959da-f46c-4b99-a97c-52143eaab56f tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:03.023125 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d98959da-f46c-4b99-a97c-52143eaab56f tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:03.023638 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-19030b05-8dc0-4671-99b1-23df99f03c43 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:03.024144 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d98959da-f46c-4b99-a97c-52143eaab56f tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:03.038626 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.wsgi [None req-d98959da-f46c-4b99-a97c-52143eaab56f tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] HTTP exception thrown: Instance 5471fc9e-e776-43fb-b11d-a617257a4a29 could not be found. Aug 09 18:50:03.044931 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-19030b05-8dc0-4671-99b1-23df99f03c43 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1522 microversion: 2.1 time: 0.190510 Aug 09 18:50:03.045913 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 89/177] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:02 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:03.048900 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-d98959da-f46c-4b99-a97c-52143eaab56f tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Request method failure captured: Aug 09 18:50:03.048900 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: request: GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29/os-volume_attachments HTTP/1.1 Aug 09 18:50:03.048900 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept: application/json Aug 09 18:50:03.048900 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept-Encoding: identity Aug 09 18:50:03.048900 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Connection: close Aug 09 18:50:03.048900 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Length: 0 Aug 09 18:50:03.048900 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Type: application/json Aug 09 18:50:03.048900 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Host: 10.222.0.57 Aug 09 18:50:03.048900 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Openstack-System-Scope: None Aug 09 18:50:03.048900 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: User-Agent: python-urllib3/1.26.11 Aug 09 18:50:03.048900 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Auth-Token: gAAAAABi8qwXoWpOCmHCs_0uoJfaFQBn3SVYEJBM9HTHYwwjKEwIQIXvWTkdP7f_WIQTSFmpkAsD3d0HCcBIY5ObkfwhcWqrwjjlL2lXvipjstWXXlIqoMot28H7RA0Dvczr2B1Miu3XaIb1zFhdun4LK06dLazuio_b45OwU22SY6M0qTbMgeA Aug 09 18:50:03.048900 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Id: None Aug 09 18:50:03.048900 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Name: None Aug 09 18:50:03.048900 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Identity-Status: Confirmed Aug 09 18:50:03.048900 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Is-Admin-Project: True Aug 09 18:50:03.048900 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Id: default Aug 09 18:50:03.048900 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Name: Default Aug 09 18:50:03.048900 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Id: 539b956efa1b47799514fbdcac7e250c Aug 09 18:50:03.048900 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Name: tempest-DeleteServersTestJSON-1912590532 Aug 09 18:50:03.048900 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Role: reader,member Aug 09 18:50:03.048900 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Roles: reader,member Aug 09 18:50:03.050443 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_539b956efa1b47799514fbdcac7e250c", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/539b956efa1b47799514fbdcac7e250c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/539b956efa1b47799514fbdcac7e250c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/539b956efa1b47799514fbdcac7e250c"}]}] Aug 09 18:50:03.050443 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant: tempest-DeleteServersTestJSON-1912590532 Aug 09 18:50:03.050443 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Id: 539b956efa1b47799514fbdcac7e250c Aug 09 18:50:03.050443 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Name: tempest-DeleteServersTestJSON-1912590532 Aug 09 18:50:03.050443 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User: tempest-DeleteServersTestJSON-1912590532-project Aug 09 18:50:03.050443 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Id: default Aug 09 18:50:03.050443 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Name: Default Aug 09 18:50:03.050443 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Id: 7fde48fb289b4c7591658e27ce5ff55e Aug 09 18:50:03.050443 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Name: tempest-DeleteServersTestJSON-1912590532-project Aug 09 18:50:03.050443 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: method: > Aug 09 18:50:03.050443 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: exception: Instance 5471fc9e-e776-43fb-b11d-a617257a4a29 could not be found. Aug 09 18:50:03.050443 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: action_args: {'server_id': '5471fc9e-e776-43fb-b11d-a617257a4a29'} Aug 09 18:50:03.051264 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:50:03.051264 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:50:03.051264 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:50:03.051264 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:50:03.051264 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:50:03.051264 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:50:03.051264 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:50:03.051264 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:50:03.051264 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:50:03.051264 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:50:03.051264 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5471fc9e-e776-43fb-b11d-a617257a4a29 could not be found. Aug 09 18:50:03.051264 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:50:03.051264 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:50:03.051264 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:50:03.051264 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:50:03.051264 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:50:03.051264 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:50:03.051264 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:50:03.051264 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:50:03.051264 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:50:03.052294 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:50:03.052294 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 18:50:03.052294 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 18:50:03.052294 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 18:50:03.052294 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 18:50:03.052294 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 09 18:50:03.052294 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 09 18:50:03.052294 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:50:03.052294 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:50:03.052294 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5471fc9e-e776-43fb-b11d-a617257a4a29 could not be found. Aug 09 18:50:03.052294 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:50:03.052294 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:50:03.052294 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:50:03.052294 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:50:03.052294 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:50:03.052294 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:50:03.052294 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:50:03.052294 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:50:03.052294 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5471fc9e-e776-43fb-b11d-a617257a4a29 could not be found. Aug 09 18:50:03.052294 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:50:03.060502 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-d98959da-f46c-4b99-a97c-52143eaab56f tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Returning 404 to user: Instance 5471fc9e-e776-43fb-b11d-a617257a4a29 could not be found. {{(pid=124726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:50:03.061561 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-d98959da-f46c-4b99-a97c-52143eaab56f tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] 10.222.0.57 "GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.055842 Aug 09 18:50:03.062127 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 89/178] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 9 18:50:03 2022] GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29/os-volume_attachments => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:50:04.067171 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e4c493f4-56c6-44ba-b789-3f964fc6107d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:04.067776 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e4c493f4-56c6-44ba-b789-3f964fc6107d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:04.073789 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e4c493f4-56c6-44ba-b789-3f964fc6107d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:04.074263 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e4c493f4-56c6-44ba-b789-3f964fc6107d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:04.074712 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e4c493f4-56c6-44ba-b789-3f964fc6107d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:04.075398 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e4c493f4-56c6-44ba-b789-3f964fc6107d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:04.075843 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e4c493f4-56c6-44ba-b789-3f964fc6107d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:04.076258 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e4c493f4-56c6-44ba-b789-3f964fc6107d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:04.225373 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e4c493f4-56c6-44ba-b789-3f964fc6107d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:04.236399 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e4c493f4-56c6-44ba-b789-3f964fc6107d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1522 microversion: 2.1 time: 0.173079 Aug 09 18:50:04.236984 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 90/179] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:04 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:50:04.686511 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-4a84cc23-4715-456d-a2d8-0ed9085c7e6e tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:04.693036 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-4a84cc23-4715-456d-a2d8-0ed9085c7e6e tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] [instance: 5471fc9e-e776-43fb-b11d-a617257a4a29] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:04.697699 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4a84cc23-4715-456d-a2d8-0ed9085c7e6e tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:04.697699 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4a84cc23-4715-456d-a2d8-0ed9085c7e6e tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:04.698159 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4a84cc23-4715-456d-a2d8-0ed9085c7e6e tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:04.699084 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4a84cc23-4715-456d-a2d8-0ed9085c7e6e tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:04.700205 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4a84cc23-4715-456d-a2d8-0ed9085c7e6e tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:04.700647 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4a84cc23-4715-456d-a2d8-0ed9085c7e6e tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:04.716819 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.wsgi [None req-4a84cc23-4715-456d-a2d8-0ed9085c7e6e tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] HTTP exception thrown: Instance 5471fc9e-e776-43fb-b11d-a617257a4a29 could not be found. Aug 09 18:50:04.719160 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-4a84cc23-4715-456d-a2d8-0ed9085c7e6e tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Request method failure captured: Aug 09 18:50:04.719160 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: request: DELETE /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29 HTTP/1.1 Aug 09 18:50:04.719160 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept: application/json Aug 09 18:50:04.719160 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept-Encoding: identity Aug 09 18:50:04.719160 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Connection: close Aug 09 18:50:04.719160 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Length: 0 Aug 09 18:50:04.719160 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Type: application/json Aug 09 18:50:04.719160 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Host: 10.222.0.57 Aug 09 18:50:04.719160 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Openstack-System-Scope: None Aug 09 18:50:04.719160 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: User-Agent: python-urllib3/1.26.11 Aug 09 18:50:04.719160 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Auth-Token: gAAAAABi8qwXoWpOCmHCs_0uoJfaFQBn3SVYEJBM9HTHYwwjKEwIQIXvWTkdP7f_WIQTSFmpkAsD3d0HCcBIY5ObkfwhcWqrwjjlL2lXvipjstWXXlIqoMot28H7RA0Dvczr2B1Miu3XaIb1zFhdun4LK06dLazuio_b45OwU22SY6M0qTbMgeA Aug 09 18:50:04.719160 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Id: None Aug 09 18:50:04.719160 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Name: None Aug 09 18:50:04.719160 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Identity-Status: Confirmed Aug 09 18:50:04.719160 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Is-Admin-Project: True Aug 09 18:50:04.719160 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Id: default Aug 09 18:50:04.719160 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Name: Default Aug 09 18:50:04.719160 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Id: 539b956efa1b47799514fbdcac7e250c Aug 09 18:50:04.719160 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Name: tempest-DeleteServersTestJSON-1912590532 Aug 09 18:50:04.719160 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Role: reader,member Aug 09 18:50:04.719160 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Roles: reader,member Aug 09 18:50:04.720312 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_539b956efa1b47799514fbdcac7e250c", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/539b956efa1b47799514fbdcac7e250c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/539b956efa1b47799514fbdcac7e250c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/539b956efa1b47799514fbdcac7e250c"}]}] Aug 09 18:50:04.720312 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant: tempest-DeleteServersTestJSON-1912590532 Aug 09 18:50:04.720312 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Id: 539b956efa1b47799514fbdcac7e250c Aug 09 18:50:04.720312 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Name: tempest-DeleteServersTestJSON-1912590532 Aug 09 18:50:04.720312 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User: tempest-DeleteServersTestJSON-1912590532-project Aug 09 18:50:04.720312 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Id: default Aug 09 18:50:04.720312 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Name: Default Aug 09 18:50:04.720312 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Id: 7fde48fb289b4c7591658e27ce5ff55e Aug 09 18:50:04.720312 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Name: tempest-DeleteServersTestJSON-1912590532-project Aug 09 18:50:04.720312 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: method: > Aug 09 18:50:04.720312 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: exception: Instance 5471fc9e-e776-43fb-b11d-a617257a4a29 could not be found. Aug 09 18:50:04.720312 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: action_args: {'id': '5471fc9e-e776-43fb-b11d-a617257a4a29'} Aug 09 18:50:04.720983 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:50:04.720983 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:50:04.720983 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:50:04.720983 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:50:04.720983 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:50:04.720983 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:50:04.720983 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:50:04.720983 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:50:04.720983 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:50:04.720983 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:50:04.720983 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5471fc9e-e776-43fb-b11d-a617257a4a29 could not be found. Aug 09 18:50:04.720983 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:50:04.720983 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:50:04.720983 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:50:04.720983 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:50:04.720983 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:50:04.720983 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:50:04.720983 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:50:04.720983 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:50:04.720983 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:50:04.722080 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:50:04.722080 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 18:50:04.722080 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 18:50:04.722080 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 18:50:04.722080 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 18:50:04.722080 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:50:04.722080 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:50:04.722080 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:50:04.722080 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:50:04.722080 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5471fc9e-e776-43fb-b11d-a617257a4a29 could not be found. Aug 09 18:50:04.722080 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:50:04.722080 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:50:04.722080 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:50:04.722080 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:50:04.722080 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:50:04.722080 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:50:04.722080 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:50:04.722080 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:50:04.722080 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5471fc9e-e776-43fb-b11d-a617257a4a29 could not be found. Aug 09 18:50:04.722080 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:50:04.723369 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-4a84cc23-4715-456d-a2d8-0ed9085c7e6e tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Returning 404 to user: Instance 5471fc9e-e776-43fb-b11d-a617257a4a29 could not be found. {{(pid=124726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:50:04.723369 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-4a84cc23-4715-456d-a2d8-0ed9085c7e6e tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] 10.222.0.57 "DELETE /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29" status: 404 len: 111 microversion: 2.1 time: 0.040049 Aug 09 18:50:04.723369 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 90/180] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 9 18:50:04 2022] DELETE /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:50:04.729771 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-df970fc4-f88f-4191-ae98-0d4d8637aa22 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:04.730388 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-df970fc4-f88f-4191-ae98-0d4d8637aa22 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] [instance: 5471fc9e-e776-43fb-b11d-a617257a4a29] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:04.736405 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-df970fc4-f88f-4191-ae98-0d4d8637aa22 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:04.736892 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-df970fc4-f88f-4191-ae98-0d4d8637aa22 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:04.737383 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-df970fc4-f88f-4191-ae98-0d4d8637aa22 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:04.738114 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-df970fc4-f88f-4191-ae98-0d4d8637aa22 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:04.738721 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-df970fc4-f88f-4191-ae98-0d4d8637aa22 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:04.739150 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-df970fc4-f88f-4191-ae98-0d4d8637aa22 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:04.755479 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-df970fc4-f88f-4191-ae98-0d4d8637aa22 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] HTTP exception thrown: Instance 5471fc9e-e776-43fb-b11d-a617257a4a29 could not be found. Aug 09 18:50:04.761693 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-df970fc4-f88f-4191-ae98-0d4d8637aa22 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Request method failure captured: Aug 09 18:50:04.761693 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: request: GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29 HTTP/1.1 Aug 09 18:50:04.761693 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept: application/json Aug 09 18:50:04.761693 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Aug 09 18:50:04.761693 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Connection: close Aug 09 18:50:04.761693 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Length: 0 Aug 09 18:50:04.761693 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Type: application/json Aug 09 18:50:04.761693 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Host: 10.222.0.57 Aug 09 18:50:04.761693 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Aug 09 18:50:04.761693 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.11 Aug 09 18:50:04.761693 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABi8qwXoWpOCmHCs_0uoJfaFQBn3SVYEJBM9HTHYwwjKEwIQIXvWTkdP7f_WIQTSFmpkAsD3d0HCcBIY5ObkfwhcWqrwjjlL2lXvipjstWXXlIqoMot28H7RA0Dvczr2B1Miu3XaIb1zFhdun4LK06dLazuio_b45OwU22SY6M0qTbMgeA Aug 09 18:50:04.761693 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Aug 09 18:50:04.761693 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Aug 09 18:50:04.761693 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Aug 09 18:50:04.761693 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Aug 09 18:50:04.761693 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Aug 09 18:50:04.761693 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Aug 09 18:50:04.761693 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Id: 539b956efa1b47799514fbdcac7e250c Aug 09 18:50:04.761693 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-DeleteServersTestJSON-1912590532 Aug 09 18:50:04.761693 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Role: reader,member Aug 09 18:50:04.761693 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Roles: reader,member Aug 09 18:50:04.762850 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_539b956efa1b47799514fbdcac7e250c", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/539b956efa1b47799514fbdcac7e250c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/539b956efa1b47799514fbdcac7e250c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/539b956efa1b47799514fbdcac7e250c"}]}] Aug 09 18:50:04.762850 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-DeleteServersTestJSON-1912590532 Aug 09 18:50:04.762850 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 539b956efa1b47799514fbdcac7e250c Aug 09 18:50:04.762850 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-DeleteServersTestJSON-1912590532 Aug 09 18:50:04.762850 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User: tempest-DeleteServersTestJSON-1912590532-project Aug 09 18:50:04.762850 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Aug 09 18:50:04.762850 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Aug 09 18:50:04.762850 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Id: 7fde48fb289b4c7591658e27ce5ff55e Aug 09 18:50:04.762850 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-DeleteServersTestJSON-1912590532-project Aug 09 18:50:04.762850 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: method: > Aug 09 18:50:04.762850 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: exception: Instance 5471fc9e-e776-43fb-b11d-a617257a4a29 could not be found. Aug 09 18:50:04.762850 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: action_args: {'id': '5471fc9e-e776-43fb-b11d-a617257a4a29'} Aug 09 18:50:04.763624 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:50:04.763624 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:50:04.763624 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:50:04.763624 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:50:04.763624 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:50:04.763624 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:50:04.763624 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:50:04.763624 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:50:04.763624 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:50:04.763624 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:50:04.763624 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5471fc9e-e776-43fb-b11d-a617257a4a29 could not be found. Aug 09 18:50:04.763624 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:50:04.763624 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:50:04.763624 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:50:04.763624 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:50:04.763624 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:50:04.763624 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:50:04.763624 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:50:04.763624 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:50:04.763624 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:50:04.764671 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:50:04.764671 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:50:04.764671 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:50:04.764671 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:50:04.764671 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:50:04.764671 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:50:04.764671 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:50:04.764671 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5471fc9e-e776-43fb-b11d-a617257a4a29 could not be found. Aug 09 18:50:04.764671 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:50:04.764671 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:50:04.764671 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:50:04.764671 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:50:04.764671 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:50:04.764671 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:50:04.764671 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:50:04.764671 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:50:04.764671 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5471fc9e-e776-43fb-b11d-a617257a4a29 could not be found. Aug 09 18:50:04.764671 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:50:04.766374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-df970fc4-f88f-4191-ae98-0d4d8637aa22 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] Returning 404 to user: Instance 5471fc9e-e776-43fb-b11d-a617257a4a29 could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:50:04.766374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-df970fc4-f88f-4191-ae98-0d4d8637aa22 tempest-DeleteServersTestJSON-1912590532 tempest-DeleteServersTestJSON-1912590532-project] 10.222.0.57 "GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29" status: 404 len: 111 microversion: 2.1 time: 0.037346 Aug 09 18:50:04.766374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 91/181] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:04 2022] GET /compute/v2.1/servers/5471fc9e-e776-43fb-b11d-a617257a4a29 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:50:05.258317 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-f68fbe4d-ffd1-454f-9dd6-3b75a9cc414b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:05.258965 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-f68fbe4d-ffd1-454f-9dd6-3b75a9cc414b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:05.265884 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f68fbe4d-ffd1-454f-9dd6-3b75a9cc414b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:05.266543 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f68fbe4d-ffd1-454f-9dd6-3b75a9cc414b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:05.267145 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f68fbe4d-ffd1-454f-9dd6-3b75a9cc414b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:05.268252 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f68fbe4d-ffd1-454f-9dd6-3b75a9cc414b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:05.268849 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f68fbe4d-ffd1-454f-9dd6-3b75a9cc414b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:05.269424 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f68fbe4d-ffd1-454f-9dd6-3b75a9cc414b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:05.560859 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-f68fbe4d-ffd1-454f-9dd6-3b75a9cc414b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:05.571100 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-f68fbe4d-ffd1-454f-9dd6-3b75a9cc414b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1522 microversion: 2.1 time: 0.316676 Aug 09 18:50:05.572296 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 91/182] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:05 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1522 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:06.595451 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-47687a91-76ad-4393-a2cf-417098ada767 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:06.596057 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-47687a91-76ad-4393-a2cf-417098ada767 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:06.602141 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-47687a91-76ad-4393-a2cf-417098ada767 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:06.602625 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-47687a91-76ad-4393-a2cf-417098ada767 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:06.603055 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-47687a91-76ad-4393-a2cf-417098ada767 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:06.603773 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-47687a91-76ad-4393-a2cf-417098ada767 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:06.604223 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-47687a91-76ad-4393-a2cf-417098ada767 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:06.604644 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-47687a91-76ad-4393-a2cf-417098ada767 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:06.780032 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-47687a91-76ad-4393-a2cf-417098ada767 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:06.793305 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-47687a91-76ad-4393-a2cf-417098ada767 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1522 microversion: 2.1 time: 0.201689 Aug 09 18:50:06.794275 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 92/183] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:06 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:07.816312 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-672996fb-bf70-4203-bb7a-d8eaf03ffb41 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:07.817023 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-672996fb-bf70-4203-bb7a-d8eaf03ffb41 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:07.823702 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-672996fb-bf70-4203-bb7a-d8eaf03ffb41 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:07.824258 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-672996fb-bf70-4203-bb7a-d8eaf03ffb41 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:07.824694 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-672996fb-bf70-4203-bb7a-d8eaf03ffb41 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:07.825408 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-672996fb-bf70-4203-bb7a-d8eaf03ffb41 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:07.825884 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-672996fb-bf70-4203-bb7a-d8eaf03ffb41 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:07.826306 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-672996fb-bf70-4203-bb7a-d8eaf03ffb41 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:07.967134 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-672996fb-bf70-4203-bb7a-d8eaf03ffb41 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:07.976066 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-672996fb-bf70-4203-bb7a-d8eaf03ffb41 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1522 microversion: 2.1 time: 0.164815 Aug 09 18:50:07.976766 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 92/184] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:07 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:08.999316 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-348b608f-6a84-4deb-822e-88b362692acb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:08.999929 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-348b608f-6a84-4deb-822e-88b362692acb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:09.006245 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-348b608f-6a84-4deb-822e-88b362692acb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:09.006735 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-348b608f-6a84-4deb-822e-88b362692acb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:09.007161 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-348b608f-6a84-4deb-822e-88b362692acb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:09.007855 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-348b608f-6a84-4deb-822e-88b362692acb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:09.008370 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-348b608f-6a84-4deb-822e-88b362692acb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:09.008788 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-348b608f-6a84-4deb-822e-88b362692acb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:09.336323 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-348b608f-6a84-4deb-822e-88b362692acb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:09.348681 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-348b608f-6a84-4deb-822e-88b362692acb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1522 microversion: 2.1 time: 0.353271 Aug 09 18:50:09.349372 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 93/185] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:08 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1522 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:10.370130 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-b66d70d4-e411-4727-a9ca-7b48faf1dc59 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:10.370743 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-b66d70d4-e411-4727-a9ca-7b48faf1dc59 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:10.379317 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b66d70d4-e411-4727-a9ca-7b48faf1dc59 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:10.379818 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b66d70d4-e411-4727-a9ca-7b48faf1dc59 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:10.380469 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b66d70d4-e411-4727-a9ca-7b48faf1dc59 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:10.384090 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b66d70d4-e411-4727-a9ca-7b48faf1dc59 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:10.384090 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b66d70d4-e411-4727-a9ca-7b48faf1dc59 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:10.384090 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b66d70d4-e411-4727-a9ca-7b48faf1dc59 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:10.626036 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-b66d70d4-e411-4727-a9ca-7b48faf1dc59 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:10.636202 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-b66d70d4-e411-4727-a9ca-7b48faf1dc59 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1522 microversion: 2.1 time: 0.270022 Aug 09 18:50:10.641028 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 93/186] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:10 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:11.658615 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-8bcacc59-f7d6-47fb-8756-5aaa6ad2be1d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:11.659217 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-8bcacc59-f7d6-47fb-8756-5aaa6ad2be1d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:11.667760 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8bcacc59-f7d6-47fb-8756-5aaa6ad2be1d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:11.667760 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8bcacc59-f7d6-47fb-8756-5aaa6ad2be1d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:11.668165 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8bcacc59-f7d6-47fb-8756-5aaa6ad2be1d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:11.668884 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8bcacc59-f7d6-47fb-8756-5aaa6ad2be1d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:11.669338 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8bcacc59-f7d6-47fb-8756-5aaa6ad2be1d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:11.669909 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8bcacc59-f7d6-47fb-8756-5aaa6ad2be1d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:11.942502 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-8bcacc59-f7d6-47fb-8756-5aaa6ad2be1d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:11.951249 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-8bcacc59-f7d6-47fb-8756-5aaa6ad2be1d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1522 microversion: 2.1 time: 0.297661 Aug 09 18:50:11.954554 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 94/187] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:11 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1522 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:12.986136 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-721c0840-cb04-462f-950e-4e6f10e69c25 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:12.986136 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-721c0840-cb04-462f-950e-4e6f10e69c25 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:12.992030 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-721c0840-cb04-462f-950e-4e6f10e69c25 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:12.992521 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-721c0840-cb04-462f-950e-4e6f10e69c25 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:12.993140 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-721c0840-cb04-462f-950e-4e6f10e69c25 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:12.994184 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-721c0840-cb04-462f-950e-4e6f10e69c25 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:12.994368 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-721c0840-cb04-462f-950e-4e6f10e69c25 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:12.994972 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-721c0840-cb04-462f-950e-4e6f10e69c25 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:13.207753 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-721c0840-cb04-462f-950e-4e6f10e69c25 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:13.215832 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-721c0840-cb04-462f-950e-4e6f10e69c25 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1522 microversion: 2.1 time: 0.235708 Aug 09 18:50:13.232932 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 94/188] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:12 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:14.239774 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-0a92ff46-33da-45b1-953a-f66bcadbb90f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:14.240387 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-0a92ff46-33da-45b1-953a-f66bcadbb90f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:14.258323 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0a92ff46-33da-45b1-953a-f66bcadbb90f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:14.259593 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0a92ff46-33da-45b1-953a-f66bcadbb90f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:14.270828 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0a92ff46-33da-45b1-953a-f66bcadbb90f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:14.271848 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0a92ff46-33da-45b1-953a-f66bcadbb90f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:14.272348 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0a92ff46-33da-45b1-953a-f66bcadbb90f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:14.275604 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0a92ff46-33da-45b1-953a-f66bcadbb90f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:14.475980 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-0a92ff46-33da-45b1-953a-f66bcadbb90f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:14.485618 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-0a92ff46-33da-45b1-953a-f66bcadbb90f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1522 microversion: 2.1 time: 0.250684 Aug 09 18:50:14.486545 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 95/189] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:14 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:50:15.506343 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-ba876c78-4a32-464b-8ae4-024f821a4d06 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:15.506951 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-ba876c78-4a32-464b-8ae4-024f821a4d06 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:15.513443 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ba876c78-4a32-464b-8ae4-024f821a4d06 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:15.514367 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ba876c78-4a32-464b-8ae4-024f821a4d06 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:15.515857 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ba876c78-4a32-464b-8ae4-024f821a4d06 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:15.516145 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ba876c78-4a32-464b-8ae4-024f821a4d06 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:15.516739 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ba876c78-4a32-464b-8ae4-024f821a4d06 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:15.517304 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ba876c78-4a32-464b-8ae4-024f821a4d06 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:15.693691 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-ba876c78-4a32-464b-8ae4-024f821a4d06 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:15.716610 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-ba876c78-4a32-464b-8ae4-024f821a4d06 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1522 microversion: 2.1 time: 0.214015 Aug 09 18:50:15.732369 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 95/190] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:15 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:16.738968 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-623b492e-eae2-4dbc-8bd2-abb566f46d1f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:16.740067 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-623b492e-eae2-4dbc-8bd2-abb566f46d1f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:16.743372 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=43 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:50:16.748940 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-623b492e-eae2-4dbc-8bd2-abb566f46d1f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:16.749467 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-623b492e-eae2-4dbc-8bd2-abb566f46d1f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:16.749925 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-623b492e-eae2-4dbc-8bd2-abb566f46d1f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:16.750910 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-623b492e-eae2-4dbc-8bd2-abb566f46d1f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:16.751527 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-623b492e-eae2-4dbc-8bd2-abb566f46d1f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:16.752111 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-623b492e-eae2-4dbc-8bd2-abb566f46d1f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:17.013850 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-623b492e-eae2-4dbc-8bd2-abb566f46d1f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:17.042747 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-623b492e-eae2-4dbc-8bd2-abb566f46d1f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1522 microversion: 2.1 time: 0.307518 Aug 09 18:50:17.044507 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 96/191] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:16 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1522 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:18.068039 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-e41cc1be-f3f0-48b6-8adc-3d54cca6f9a3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:18.068932 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-e41cc1be-f3f0-48b6-8adc-3d54cca6f9a3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:18.086334 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e41cc1be-f3f0-48b6-8adc-3d54cca6f9a3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:18.087182 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e41cc1be-f3f0-48b6-8adc-3d54cca6f9a3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:18.087759 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e41cc1be-f3f0-48b6-8adc-3d54cca6f9a3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:18.088667 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e41cc1be-f3f0-48b6-8adc-3d54cca6f9a3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:18.089497 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e41cc1be-f3f0-48b6-8adc-3d54cca6f9a3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:18.090037 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e41cc1be-f3f0-48b6-8adc-3d54cca6f9a3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:18.955729 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-e41cc1be-f3f0-48b6-8adc-3d54cca6f9a3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:18.964784 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-e41cc1be-f3f0-48b6-8adc-3d54cca6f9a3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1522 microversion: 2.1 time: 0.901944 Aug 09 18:50:18.968005 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 96/192] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:18 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1522 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:19.992625 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-2fba8c83-01b0-4e3e-aa52-bcf81adaf5f7 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:19.993839 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-2fba8c83-01b0-4e3e-aa52-bcf81adaf5f7 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:20.001250 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2fba8c83-01b0-4e3e-aa52-bcf81adaf5f7 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:20.002045 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2fba8c83-01b0-4e3e-aa52-bcf81adaf5f7 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:20.007149 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2fba8c83-01b0-4e3e-aa52-bcf81adaf5f7 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:20.008398 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2fba8c83-01b0-4e3e-aa52-bcf81adaf5f7 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:20.009466 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2fba8c83-01b0-4e3e-aa52-bcf81adaf5f7 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:20.012038 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2fba8c83-01b0-4e3e-aa52-bcf81adaf5f7 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:20.313147 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-2fba8c83-01b0-4e3e-aa52-bcf81adaf5f7 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:20.324731 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-2fba8c83-01b0-4e3e-aa52-bcf81adaf5f7 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1522 microversion: 2.1 time: 0.339431 Aug 09 18:50:20.325336 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 97/193] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:19 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1522 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:21.346309 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-e3f51482-66ad-4d3c-b58e-5eb9022a8d4a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:21.346964 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-e3f51482-66ad-4d3c-b58e-5eb9022a8d4a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:21.352367 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:50:21.362707 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e3f51482-66ad-4d3c-b58e-5eb9022a8d4a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:21.363995 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e3f51482-66ad-4d3c-b58e-5eb9022a8d4a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:21.364469 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e3f51482-66ad-4d3c-b58e-5eb9022a8d4a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:21.366563 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e3f51482-66ad-4d3c-b58e-5eb9022a8d4a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:21.367051 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e3f51482-66ad-4d3c-b58e-5eb9022a8d4a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:21.371804 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e3f51482-66ad-4d3c-b58e-5eb9022a8d4a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:21.626818 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-e3f51482-66ad-4d3c-b58e-5eb9022a8d4a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:21.636415 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-e3f51482-66ad-4d3c-b58e-5eb9022a8d4a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1522 microversion: 2.1 time: 0.295081 Aug 09 18:50:21.638328 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 97/194] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:21 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:22.660130 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-40a6d9e0-3479-4cfc-b5cc-423acc3299ab tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:22.661381 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-40a6d9e0-3479-4cfc-b5cc-423acc3299ab tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:22.674964 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-40a6d9e0-3479-4cfc-b5cc-423acc3299ab tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:22.675552 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-40a6d9e0-3479-4cfc-b5cc-423acc3299ab tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:22.677988 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-40a6d9e0-3479-4cfc-b5cc-423acc3299ab tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:22.678947 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-40a6d9e0-3479-4cfc-b5cc-423acc3299ab tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:22.679547 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-40a6d9e0-3479-4cfc-b5cc-423acc3299ab tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:22.680052 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-40a6d9e0-3479-4cfc-b5cc-423acc3299ab tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:22.923471 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-40a6d9e0-3479-4cfc-b5cc-423acc3299ab tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:22.934962 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-40a6d9e0-3479-4cfc-b5cc-423acc3299ab tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1522 microversion: 2.1 time: 0.279758 Aug 09 18:50:22.942347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 98/195] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:22 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:22.994515 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-1a573ae4-b37f-4419-baa2-f81e218de2e0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Action: 'create', calling method: .version_select at 0x7f8d6a695f70>, body: {"keypair": {"name": "tempest-keypair-1157083449", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCJl18WTqyt2dr9ZwOqgxOerUbr8ad6Mk8RgdC0l/rR4rn6HIdd9sZi5NF6D+AuXyQQRO+iJSqWiTBcO4eHNcMOsiPxFpronYWBs1jWvNmYiquZ9/eOV6QZRZuCAsuffxw=="}} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:50:23.020383 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.quota [None req-1a573ae4-b37f-4419-baa2-f81e218de2e0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Getting quotas for project 4a745db383cb452187f7c82b9977c09b. Resources: {'key_pairs'} {{(pid=124726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:50:23.024648 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.quota [None req-1a573ae4-b37f-4419-baa2-f81e218de2e0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Getting quotas for user 00491255f4b44125b6dc9f816c9bbb58 and project 4a745db383cb452187f7c82b9977c09b. Resources: {'key_pairs'} {{(pid=124726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:50:23.185045 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-1a573ae4-b37f-4419-baa2-f81e218de2e0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.406367 Aug 09 18:50:23.190409 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 98/196] 10.222.0.57 () {60 vars in 1159 bytes} [Tue Aug 9 18:50:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:50:23.958652 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-7d3d326b-aa74-4416-920d-939fa2d6e0b3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:23.959402 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-7d3d326b-aa74-4416-920d-939fa2d6e0b3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:23.966992 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7d3d326b-aa74-4416-920d-939fa2d6e0b3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:23.967543 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7d3d326b-aa74-4416-920d-939fa2d6e0b3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:23.973395 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7d3d326b-aa74-4416-920d-939fa2d6e0b3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:23.973395 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7d3d326b-aa74-4416-920d-939fa2d6e0b3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:23.973395 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7d3d326b-aa74-4416-920d-939fa2d6e0b3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:23.973395 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7d3d326b-aa74-4416-920d-939fa2d6e0b3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:23.990838 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=100 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:50:24.226410 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-7d3d326b-aa74-4416-920d-939fa2d6e0b3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:24.234535 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-7d3d326b-aa74-4416-920d-939fa2d6e0b3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1522 microversion: 2.1 time: 0.280229 Aug 09 18:50:24.235112 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 99/197] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:23 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:24.734149 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-20033181-9efe-4a74-a432-4bd333dbd751 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Action: 'create', calling method: .version_select at 0x7f8d6a6b2310>, body: {"keypair": {"name": "tempest-TestShelveInstance-328605986", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjO/8GHk2Pcy0X08m3K1SxfIrhSpY/DeYNanQxPTGoYfFiHBrwkBlqYqs4bKRLcCnMq+OA39Cp/TUScN5sUMSfW25pps7+M7B5u7JXUo+TLCFDzQ7R0/PlV4Xpnz+c6rA=="}} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:50:24.761678 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.quota [None req-20033181-9efe-4a74-a432-4bd333dbd751 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Getting quotas for project 6efde3fd7658438cad16413a10503384. Resources: {'key_pairs'} {{(pid=124726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:50:24.767946 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.quota [None req-20033181-9efe-4a74-a432-4bd333dbd751 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Getting quotas for user dc285681bd4843028f0fbbbd01ff4adb and project 6efde3fd7658438cad16413a10503384. Resources: {'key_pairs'} {{(pid=124726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:50:24.924630 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-20033181-9efe-4a74-a432-4bd333dbd751 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.305500 Aug 09 18:50:24.934750 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 99/198] 10.222.0.57 () {60 vars in 1159 bytes} [Tue Aug 9 18:50:24 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:50:25.270314 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-40d498a7-4f72-4adb-acef-5f430d684aa3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:25.271619 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-40d498a7-4f72-4adb-acef-5f430d684aa3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:25.284193 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-40d498a7-4f72-4adb-acef-5f430d684aa3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:25.284722 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-40d498a7-4f72-4adb-acef-5f430d684aa3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:25.285159 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-40d498a7-4f72-4adb-acef-5f430d684aa3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:25.285897 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-40d498a7-4f72-4adb-acef-5f430d684aa3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:25.286348 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-40d498a7-4f72-4adb-acef-5f430d684aa3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:25.298709 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-40d498a7-4f72-4adb-acef-5f430d684aa3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:25.465331 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-40d498a7-4f72-4adb-acef-5f430d684aa3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:25.474078 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-40d498a7-4f72-4adb-acef-5f430d684aa3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1522 microversion: 2.1 time: 0.217662 Aug 09 18:50:25.494003 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 100/199] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:25 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:26.463756 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-b58f9d73-6106-423e-9d86-a5472b228763 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1726165401", "imageRef": "124dd477-ccfa-4be3-9973-6b1f33b47df8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c83a464f-4efd-4554-9508-d2b73d3a8a45"}], "security_groups": [{"name": "tempest-securitygroup--1544897652"}], "key_name": "tempest-keypair-1157083449", "user_data": "}} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:50:26.500389 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e1a6344b-c21a-4cc7-b8f9-f9cf27187815 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:26.501062 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e1a6344b-c21a-4cc7-b8f9-f9cf27187815 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:26.513181 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e1a6344b-c21a-4cc7-b8f9-f9cf27187815 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:26.513784 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e1a6344b-c21a-4cc7-b8f9-f9cf27187815 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:26.514741 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e1a6344b-c21a-4cc7-b8f9-f9cf27187815 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:26.520222 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e1a6344b-c21a-4cc7-b8f9-f9cf27187815 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:26.520627 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e1a6344b-c21a-4cc7-b8f9-f9cf27187815 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:26.521121 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e1a6344b-c21a-4cc7-b8f9-f9cf27187815 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:26.617961 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.network.neutron [None req-b58f9d73-6106-423e-9d86-a5472b228763 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] validate_networks() for [('c83a464f-4efd-4554-9508-d2b73d3a8a45', None, None, None, None, None)] {{(pid=124726) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:50:26.752717 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e1a6344b-c21a-4cc7-b8f9-f9cf27187815 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:26.760657 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e1a6344b-c21a-4cc7-b8f9-f9cf27187815 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1522 microversion: 2.1 time: 0.264180 Aug 09 18:50:26.763303 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 101/200] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:26 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:27.092371 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.virt.hardware [None req-b58f9d73-6106-423e-9d86-a5472b228763 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Flavor limits 0:0:0 {{(pid=124726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:50:27.092818 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.virt.hardware [None req-b58f9d73-6106-423e-9d86-a5472b228763 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Image limits 0:0:0 {{(pid=124726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:50:27.093304 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.virt.hardware [None req-b58f9d73-6106-423e-9d86-a5472b228763 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Flavor pref 0:0:0 {{(pid=124726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:50:27.093794 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.virt.hardware [None req-b58f9d73-6106-423e-9d86-a5472b228763 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Image pref 0:0:0 {{(pid=124726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:50:27.094222 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.virt.hardware [None req-b58f9d73-6106-423e-9d86-a5472b228763 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:50:27.102911 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b58f9d73-6106-423e-9d86-a5472b228763 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:27.103394 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b58f9d73-6106-423e-9d86-a5472b228763 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:27.103824 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b58f9d73-6106-423e-9d86-a5472b228763 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:27.104707 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b58f9d73-6106-423e-9d86-a5472b228763 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:27.105263 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b58f9d73-6106-423e-9d86-a5472b228763 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:27.113434 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b58f9d73-6106-423e-9d86-a5472b228763 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:27.160216 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.quota [None req-b58f9d73-6106-423e-9d86-a5472b228763 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Getting quotas for project 4a745db383cb452187f7c82b9977c09b. Resources: {'cores', 'ram', 'instances'} {{(pid=124726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:50:27.166109 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.quota [None req-b58f9d73-6106-423e-9d86-a5472b228763 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Getting quotas for user 00491255f4b44125b6dc9f816c9bbb58 and project 4a745db383cb452187f7c82b9977c09b. Resources: {'cores', 'ram', 'instances'} {{(pid=124726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:50:27.199900 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-b58f9d73-6106-423e-9d86-a5472b228763 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Going to run 1 instances... {{(pid=124726) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:50:27.202762 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-b58f9d73-6106-423e-9d86-a5472b228763 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='124dd477-ccfa-4be3-9973-6b1f33b47df8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:50:27.378459 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-b58f9d73-6106-423e-9d86-a5472b228763 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.919014 Aug 09 18:50:27.391942 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 100/201] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 9 18:50:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:50:27.410592 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e48b6c60-6210-4049-b6db-893ae9d975b0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:27.411201 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e48b6c60-6210-4049-b6db-893ae9d975b0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:27.503299 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e48b6c60-6210-4049-b6db-893ae9d975b0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:27.514715 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e48b6c60-6210-4049-b6db-893ae9d975b0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9" status: 200 len: 1242 microversion: 2.1 time: 0.114729 Aug 09 18:50:27.515884 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 102/202] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:27 2022] GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9 => generated 1242 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:27.786176 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-662f4bef-f300-48ac-b382-7cd3b36ab4ef tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:27.786989 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-662f4bef-f300-48ac-b382-7cd3b36ab4ef tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:27.800772 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-662f4bef-f300-48ac-b382-7cd3b36ab4ef tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:27.802170 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-662f4bef-f300-48ac-b382-7cd3b36ab4ef tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:27.803203 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-662f4bef-f300-48ac-b382-7cd3b36ab4ef tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:27.804699 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-662f4bef-f300-48ac-b382-7cd3b36ab4ef tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:27.805375 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-662f4bef-f300-48ac-b382-7cd3b36ab4ef tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:27.805958 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-662f4bef-f300-48ac-b382-7cd3b36ab4ef tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:27.811510 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:50:28.132138 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-662f4bef-f300-48ac-b382-7cd3b36ab4ef tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:28.140205 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-662f4bef-f300-48ac-b382-7cd3b36ab4ef tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1522 microversion: 2.1 time: 0.362519 Aug 09 18:50:28.140782 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 101/203] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:27 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:28.537704 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-1f762b43-00e8-43cd-8001-251e67f6df6f tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:28.538397 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-1f762b43-00e8-43cd-8001-251e67f6df6f tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:28.660119 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1f762b43-00e8-43cd-8001-251e67f6df6f tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:28.670645 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-1f762b43-00e8-43cd-8001-251e67f6df6f tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9" status: 200 len: 1242 microversion: 2.1 time: 0.136767 Aug 09 18:50:28.673603 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 103/204] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:28 2022] GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9 => generated 1242 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:29.165594 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-7b39d620-9a28-4646-b416-677afe20df19 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:29.165594 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-7b39d620-9a28-4646-b416-677afe20df19 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:29.172117 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7b39d620-9a28-4646-b416-677afe20df19 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:29.172959 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7b39d620-9a28-4646-b416-677afe20df19 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:29.173883 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7b39d620-9a28-4646-b416-677afe20df19 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:29.175711 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7b39d620-9a28-4646-b416-677afe20df19 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:29.176234 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7b39d620-9a28-4646-b416-677afe20df19 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:29.176746 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7b39d620-9a28-4646-b416-677afe20df19 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:29.479267 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-7b39d620-9a28-4646-b416-677afe20df19 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:29.490245 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-7b39d620-9a28-4646-b416-677afe20df19 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1522 microversion: 2.1 time: 0.332787 Aug 09 18:50:29.491885 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 102/205] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:29 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:29.701190 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-31816846-92ef-4372-811f-32354b635018 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:29.702358 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-31816846-92ef-4372-811f-32354b635018 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:29.733989 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-31816846-92ef-4372-811f-32354b635018 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:29.735379 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-31816846-92ef-4372-811f-32354b635018 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:29.738634 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-31816846-92ef-4372-811f-32354b635018 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:29.739788 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-31816846-92ef-4372-811f-32354b635018 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:29.741344 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-31816846-92ef-4372-811f-32354b635018 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:29.743980 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-31816846-92ef-4372-811f-32354b635018 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:29.886249 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-31816846-92ef-4372-811f-32354b635018 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:29.914450 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-31816846-92ef-4372-811f-32354b635018 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9" status: 200 len: 1246 microversion: 2.1 time: 0.223334 Aug 09 18:50:29.929982 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 104/206] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:29 2022] GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9 => generated 1246 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:30.517945 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-a0326c61-be5c-4c36-8b9c-c03936a3f2f1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:30.519338 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-a0326c61-be5c-4c36-8b9c-c03936a3f2f1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:30.533971 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a0326c61-be5c-4c36-8b9c-c03936a3f2f1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:30.534527 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a0326c61-be5c-4c36-8b9c-c03936a3f2f1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:30.535032 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a0326c61-be5c-4c36-8b9c-c03936a3f2f1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:30.535919 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a0326c61-be5c-4c36-8b9c-c03936a3f2f1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:30.536380 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a0326c61-be5c-4c36-8b9c-c03936a3f2f1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:30.536867 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a0326c61-be5c-4c36-8b9c-c03936a3f2f1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:30.712080 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-a0326c61-be5c-4c36-8b9c-c03936a3f2f1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:30.720634 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-a0326c61-be5c-4c36-8b9c-c03936a3f2f1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1522 microversion: 2.1 time: 0.210426 Aug 09 18:50:30.721485 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 103/207] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:30 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:30.947527 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-776a3665-2a2e-43bf-8c0e-be2276e3be55 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:30.948672 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-776a3665-2a2e-43bf-8c0e-be2276e3be55 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:30.955192 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-776a3665-2a2e-43bf-8c0e-be2276e3be55 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:30.955681 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-776a3665-2a2e-43bf-8c0e-be2276e3be55 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:30.956324 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-776a3665-2a2e-43bf-8c0e-be2276e3be55 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:30.957307 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-776a3665-2a2e-43bf-8c0e-be2276e3be55 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:30.957883 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-776a3665-2a2e-43bf-8c0e-be2276e3be55 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:30.958371 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-776a3665-2a2e-43bf-8c0e-be2276e3be55 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:31.039590 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-776a3665-2a2e-43bf-8c0e-be2276e3be55 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:31.047704 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-776a3665-2a2e-43bf-8c0e-be2276e3be55 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9" status: 200 len: 1294 microversion: 2.1 time: 0.104133 Aug 09 18:50:31.048273 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 105/208] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:30 2022] GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9 => generated 1294 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:50:31.741966 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-7f8ba9a7-9e01-49aa-a525-78867b9bf115 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:31.743301 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-7f8ba9a7-9e01-49aa-a525-78867b9bf115 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:31.751086 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7f8ba9a7-9e01-49aa-a525-78867b9bf115 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:31.751937 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7f8ba9a7-9e01-49aa-a525-78867b9bf115 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:31.752607 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7f8ba9a7-9e01-49aa-a525-78867b9bf115 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:31.753545 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7f8ba9a7-9e01-49aa-a525-78867b9bf115 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:31.754098 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7f8ba9a7-9e01-49aa-a525-78867b9bf115 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:31.754578 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7f8ba9a7-9e01-49aa-a525-78867b9bf115 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:31.936950 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-7f8ba9a7-9e01-49aa-a525-78867b9bf115 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:31.945966 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-7f8ba9a7-9e01-49aa-a525-78867b9bf115 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1502 microversion: 2.1 time: 0.208187 Aug 09 18:50:31.946559 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 104/209] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:31 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1502 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:31.967771 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-8cfa732b-b29c-4fc3-b958-6644359cae36 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:31.971066 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-8cfa732b-b29c-4fc3-b958-6644359cae36 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:31.976099 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8cfa732b-b29c-4fc3-b958-6644359cae36 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:31.976703 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8cfa732b-b29c-4fc3-b958-6644359cae36 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:31.977209 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8cfa732b-b29c-4fc3-b958-6644359cae36 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:31.978125 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8cfa732b-b29c-4fc3-b958-6644359cae36 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:31.979214 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8cfa732b-b29c-4fc3-b958-6644359cae36 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:31.979733 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8cfa732b-b29c-4fc3-b958-6644359cae36 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:32.072913 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-e4e2ddc3-eee0-4396-9a01-634b808d57fe tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:32.073546 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-e4e2ddc3-eee0-4396-9a01-634b808d57fe tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:32.083854 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e4e2ddc3-eee0-4396-9a01-634b808d57fe tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:32.084351 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e4e2ddc3-eee0-4396-9a01-634b808d57fe tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:32.084790 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e4e2ddc3-eee0-4396-9a01-634b808d57fe tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:32.085586 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e4e2ddc3-eee0-4396-9a01-634b808d57fe tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:32.086328 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e4e2ddc3-eee0-4396-9a01-634b808d57fe tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:32.087018 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e4e2ddc3-eee0-4396-9a01-634b808d57fe tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:32.163227 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-e4e2ddc3-eee0-4396-9a01-634b808d57fe tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:32.170731 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-8cfa732b-b29c-4fc3-b958-6644359cae36 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:32.171373 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-e4e2ddc3-eee0-4396-9a01-634b808d57fe tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9" status: 200 len: 1302 microversion: 2.1 time: 0.102398 Aug 09 18:50:32.176683 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 105/210] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:32 2022] GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9 => generated 1302 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:32.189975 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-8cfa732b-b29c-4fc3-b958-6644359cae36 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1517 microversion: 2.1 time: 0.216612 Aug 09 18:50:32.189975 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 106/211] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:31 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1517 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:33.202467 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-1ec00211-3f5e-41f5-b740-913b09e2552a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:33.203145 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-1ec00211-3f5e-41f5-b740-913b09e2552a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:33.210062 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1ec00211-3f5e-41f5-b740-913b09e2552a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:33.210544 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1ec00211-3f5e-41f5-b740-913b09e2552a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:33.210977 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1ec00211-3f5e-41f5-b740-913b09e2552a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:33.211744 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1ec00211-3f5e-41f5-b740-913b09e2552a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:33.212205 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1ec00211-3f5e-41f5-b740-913b09e2552a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:33.212630 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1ec00211-3f5e-41f5-b740-913b09e2552a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:33.289154 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-1ec00211-3f5e-41f5-b740-913b09e2552a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:33.296550 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-1ec00211-3f5e-41f5-b740-913b09e2552a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9" status: 200 len: 1302 microversion: 2.1 time: 0.098676 Aug 09 18:50:33.297123 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 106/212] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:33 2022] GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9 => generated 1302 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:34.318838 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-0fd2e8f8-2d6f-41b1-acba-0f6e6d861830 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:34.319815 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-0fd2e8f8-2d6f-41b1-acba-0f6e6d861830 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:34.329504 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0fd2e8f8-2d6f-41b1-acba-0f6e6d861830 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:34.330328 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0fd2e8f8-2d6f-41b1-acba-0f6e6d861830 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:34.331072 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0fd2e8f8-2d6f-41b1-acba-0f6e6d861830 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:34.332285 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0fd2e8f8-2d6f-41b1-acba-0f6e6d861830 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:34.333104 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0fd2e8f8-2d6f-41b1-acba-0f6e6d861830 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:34.333912 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0fd2e8f8-2d6f-41b1-acba-0f6e6d861830 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:34.398873 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-0fd2e8f8-2d6f-41b1-acba-0f6e6d861830 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:34.406789 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-0fd2e8f8-2d6f-41b1-acba-0f6e6d861830 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9" status: 200 len: 1302 microversion: 2.1 time: 0.093041 Aug 09 18:50:34.407373 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 107/213] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:34 2022] GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9 => generated 1302 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:35.132262 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-4a5540f3-3fa4-40b9-8855-33b028629ee4 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:50:35.136038 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-4a5540f3-3fa4-40b9-8855-33b028629ee4 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:35.144702 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4a5540f3-3fa4-40b9-8855-33b028629ee4 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:35.145410 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4a5540f3-3fa4-40b9-8855-33b028629ee4 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:35.146456 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4a5540f3-3fa4-40b9-8855-33b028629ee4 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:35.147659 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4a5540f3-3fa4-40b9-8855-33b028629ee4 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:35.148282 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4a5540f3-3fa4-40b9-8855-33b028629ee4 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:35.149020 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4a5540f3-3fa4-40b9-8855-33b028629ee4 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:35.197323 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.objects.instance [None req-4a5540f3-3fa4-40b9-8855-33b028629ee4 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lazy-loading 'flavor' on Instance uuid 650af48c-836d-4078-abb6-4b865a22a7d8 {{(pid=124726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:50:35.428365 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-7ca8446d-f4da-4942-a813-7a1009fcb140 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:35.429247 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-7ca8446d-f4da-4942-a813-7a1009fcb140 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:35.442740 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7ca8446d-f4da-4942-a813-7a1009fcb140 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:35.443409 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7ca8446d-f4da-4942-a813-7a1009fcb140 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:35.443865 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7ca8446d-f4da-4942-a813-7a1009fcb140 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:35.444996 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7ca8446d-f4da-4942-a813-7a1009fcb140 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:35.445460 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7ca8446d-f4da-4942-a813-7a1009fcb140 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:35.446146 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7ca8446d-f4da-4942-a813-7a1009fcb140 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:35.540918 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-4a5540f3-3fa4-40b9-8855-33b028629ee4 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "POST /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8/action" status: 200 len: 32 microversion: 2.1 time: 0.413835 Aug 09 18:50:35.541956 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 107/214] 10.222.0.57 () {60 vars in 1278 bytes} [Tue Aug 9 18:50:35 2022] POST /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8/action => generated 32 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 18:50:35.559060 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-62b950a0-5cfd-4db6-aee0-c334fa17cae0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:35.559757 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-62b950a0-5cfd-4db6-aee0-c334fa17cae0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:35.570459 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-62b950a0-5cfd-4db6-aee0-c334fa17cae0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:35.571158 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-62b950a0-5cfd-4db6-aee0-c334fa17cae0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:35.571772 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-62b950a0-5cfd-4db6-aee0-c334fa17cae0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:35.575121 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-62b950a0-5cfd-4db6-aee0-c334fa17cae0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:35.575832 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-62b950a0-5cfd-4db6-aee0-c334fa17cae0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:35.576462 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-62b950a0-5cfd-4db6-aee0-c334fa17cae0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:35.664714 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-7ca8446d-f4da-4942-a813-7a1009fcb140 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:35.673955 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-7ca8446d-f4da-4942-a813-7a1009fcb140 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9" status: 200 len: 1368 microversion: 2.1 time: 0.249776 Aug 09 18:50:35.675162 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 108/215] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:35 2022] GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9 => generated 1368 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:50:36.000174 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-62b950a0-5cfd-4db6-aee0-c334fa17cae0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:36.008376 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-62b950a0-5cfd-4db6-aee0-c334fa17cae0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1523 microversion: 2.1 time: 0.454699 Aug 09 18:50:36.008977 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 108/216] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:35 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1523 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:50:36.696846 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c3fd303e-c407-4976-a3ec-7ed10272366e tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:36.697506 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-c3fd303e-c407-4976-a3ec-7ed10272366e tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:36.709853 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c3fd303e-c407-4976-a3ec-7ed10272366e tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:36.710351 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c3fd303e-c407-4976-a3ec-7ed10272366e tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:36.710786 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c3fd303e-c407-4976-a3ec-7ed10272366e tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:36.711501 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c3fd303e-c407-4976-a3ec-7ed10272366e tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:36.711951 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c3fd303e-c407-4976-a3ec-7ed10272366e tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:36.712419 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c3fd303e-c407-4976-a3ec-7ed10272366e tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:36.878249 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-c3fd303e-c407-4976-a3ec-7ed10272366e tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:36.888424 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-c3fd303e-c407-4976-a3ec-7ed10272366e tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9" status: 200 len: 1368 microversion: 2.1 time: 0.195664 Aug 09 18:50:36.889701 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 109/217] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:36 2022] GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9 => generated 1368 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:36.960260 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-734732b6-96dc-4e05-9dc3-92b69b9a2872 req-a3d56ef7-0e47-4b41-8068-014bd953df24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "743aafc6-1787-4c6e-be09-3b460a00d5e9", "tag": "2a32c700-6fce-4e74-b894-56a5eba16aed"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:50:36.970033 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-734732b6-96dc-4e05-9dc3-92b69b9a2872 req-a3d56ef7-0e47-4b41-8068-014bd953df24 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:36.970544 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-734732b6-96dc-4e05-9dc3-92b69b9a2872 req-a3d56ef7-0e47-4b41-8068-014bd953df24 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:36.973656 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-734732b6-96dc-4e05-9dc3-92b69b9a2872 req-a3d56ef7-0e47-4b41-8068-014bd953df24 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:36.982290 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-734732b6-96dc-4e05-9dc3-92b69b9a2872 req-a3d56ef7-0e47-4b41-8068-014bd953df24 service nova] Creating event network-changed:2a32c700-6fce-4e74-b894-56a5eba16aed for instance 743aafc6-1787-4c6e-be09-3b460a00d5e9 on hv-cinder-82660 Aug 09 18:50:36.987608 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-734732b6-96dc-4e05-9dc3-92b69b9a2872 req-a3d56ef7-0e47-4b41-8068-014bd953df24 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031078 Aug 09 18:50:36.988221 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 109/218] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:50:37.030422 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-349b61c4-f731-4a4b-9e67-c7eebdf0ea68 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:37.031459 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-349b61c4-f731-4a4b-9e67-c7eebdf0ea68 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:37.040182 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-349b61c4-f731-4a4b-9e67-c7eebdf0ea68 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:37.042040 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-349b61c4-f731-4a4b-9e67-c7eebdf0ea68 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:37.042710 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-349b61c4-f731-4a4b-9e67-c7eebdf0ea68 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:37.044600 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-349b61c4-f731-4a4b-9e67-c7eebdf0ea68 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:37.045598 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-349b61c4-f731-4a4b-9e67-c7eebdf0ea68 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:37.046033 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-349b61c4-f731-4a4b-9e67-c7eebdf0ea68 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:37.189190 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-349b61c4-f731-4a4b-9e67-c7eebdf0ea68 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:37.197300 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-349b61c4-f731-4a4b-9e67-c7eebdf0ea68 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1523 microversion: 2.1 time: 0.170722 Aug 09 18:50:37.200810 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 110/219] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:37 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:37.910147 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell0:SELECT=2 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:50:37.911507 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell0:SELECT=14 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:50:37.915993 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-5ca0af1d-4ffd-428a-8828-c1ead54de0de tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:37.916731 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-5ca0af1d-4ffd-428a-8828-c1ead54de0de tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:37.923732 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5ca0af1d-4ffd-428a-8828-c1ead54de0de tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:37.924521 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5ca0af1d-4ffd-428a-8828-c1ead54de0de tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:37.924958 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5ca0af1d-4ffd-428a-8828-c1ead54de0de tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:37.925712 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5ca0af1d-4ffd-428a-8828-c1ead54de0de tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:37.926168 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5ca0af1d-4ffd-428a-8828-c1ead54de0de tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:37.926594 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5ca0af1d-4ffd-428a-8828-c1ead54de0de tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:38.067216 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-5ca0af1d-4ffd-428a-8828-c1ead54de0de tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:38.074776 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-5ca0af1d-4ffd-428a-8828-c1ead54de0de tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9" status: 200 len: 1368 microversion: 2.1 time: 0.165687 Aug 09 18:50:38.075340 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 110/220] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:37 2022] GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:38.216991 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-4195fb79-9e19-429b-adc2-d4362f0652a0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:38.217633 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-4195fb79-9e19-429b-adc2-d4362f0652a0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:38.223615 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4195fb79-9e19-429b-adc2-d4362f0652a0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:38.224096 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4195fb79-9e19-429b-adc2-d4362f0652a0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:38.224528 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4195fb79-9e19-429b-adc2-d4362f0652a0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:38.225211 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4195fb79-9e19-429b-adc2-d4362f0652a0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:38.225727 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4195fb79-9e19-429b-adc2-d4362f0652a0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:38.226147 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4195fb79-9e19-429b-adc2-d4362f0652a0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:38.372697 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-4195fb79-9e19-429b-adc2-d4362f0652a0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:38.380819 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-4195fb79-9e19-429b-adc2-d4362f0652a0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1523 microversion: 2.1 time: 0.167619 Aug 09 18:50:38.381385 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 111/221] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:38 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:39.097482 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-1757041a-0c1f-4db1-9caf-2c4fa7c90c47 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:39.098174 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-1757041a-0c1f-4db1-9caf-2c4fa7c90c47 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:39.105274 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1757041a-0c1f-4db1-9caf-2c4fa7c90c47 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:39.105803 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1757041a-0c1f-4db1-9caf-2c4fa7c90c47 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:39.106239 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1757041a-0c1f-4db1-9caf-2c4fa7c90c47 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:39.106930 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1757041a-0c1f-4db1-9caf-2c4fa7c90c47 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:39.107378 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1757041a-0c1f-4db1-9caf-2c4fa7c90c47 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:39.108383 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1757041a-0c1f-4db1-9caf-2c4fa7c90c47 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:39.254866 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-1757041a-0c1f-4db1-9caf-2c4fa7c90c47 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:39.262556 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-1757041a-0c1f-4db1-9caf-2c4fa7c90c47 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9" status: 200 len: 1368 microversion: 2.1 time: 0.170343 Aug 09 18:50:39.264293 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 111/222] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:39 2022] GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9 => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:39.402704 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-ed9ce912-4471-412b-878f-5ca1607c861a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:39.403237 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-ed9ce912-4471-412b-878f-5ca1607c861a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:39.405774 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=4 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:50:39.410676 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ed9ce912-4471-412b-878f-5ca1607c861a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:39.411163 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ed9ce912-4471-412b-878f-5ca1607c861a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:39.411592 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ed9ce912-4471-412b-878f-5ca1607c861a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:39.412316 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ed9ce912-4471-412b-878f-5ca1607c861a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:39.412769 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ed9ce912-4471-412b-878f-5ca1607c861a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:39.414125 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ed9ce912-4471-412b-878f-5ca1607c861a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:39.561629 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-ed9ce912-4471-412b-878f-5ca1607c861a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:39.569516 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-ed9ce912-4471-412b-878f-5ca1607c861a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1523 microversion: 2.1 time: 0.171134 Aug 09 18:50:39.570187 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 112/223] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:39 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:39.785391 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-58a5daf7-fdf7-415c-9276-2f69655b90a4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:39.785895 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-58a5daf7-fdf7-415c-9276-2f69655b90a4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:39.792363 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-58a5daf7-fdf7-415c-9276-2f69655b90a4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:39.792855 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-58a5daf7-fdf7-415c-9276-2f69655b90a4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:39.793287 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-58a5daf7-fdf7-415c-9276-2f69655b90a4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:39.794005 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-58a5daf7-fdf7-415c-9276-2f69655b90a4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:39.794457 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-58a5daf7-fdf7-415c-9276-2f69655b90a4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:39.794883 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-58a5daf7-fdf7-415c-9276-2f69655b90a4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:39.819769 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-58a5daf7-fdf7-415c-9276-2f69655b90a4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af/ips" status: 200 len: 145 microversion: 2.1 time: 0.038252 Aug 09 18:50:39.821104 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 112/224] 10.222.0.57 () {58 vars in 1248 bytes} [Tue Aug 9 18:50:39 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:50:40.284313 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-8b09d009-e7ab-47d7-8b7e-7ae323ae2f27 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:40.284925 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-8b09d009-e7ab-47d7-8b7e-7ae323ae2f27 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:40.291474 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8b09d009-e7ab-47d7-8b7e-7ae323ae2f27 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:40.291953 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8b09d009-e7ab-47d7-8b7e-7ae323ae2f27 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:40.292384 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8b09d009-e7ab-47d7-8b7e-7ae323ae2f27 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:40.293117 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8b09d009-e7ab-47d7-8b7e-7ae323ae2f27 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:40.293614 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8b09d009-e7ab-47d7-8b7e-7ae323ae2f27 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:40.294043 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8b09d009-e7ab-47d7-8b7e-7ae323ae2f27 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:40.432969 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-8b09d009-e7ab-47d7-8b7e-7ae323ae2f27 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:40.441257 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-8b09d009-e7ab-47d7-8b7e-7ae323ae2f27 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9" status: 200 len: 1368 microversion: 2.1 time: 0.160728 Aug 09 18:50:40.441982 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 113/225] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:40 2022] GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:50:40.592243 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-f3c8c6f3-1f1c-444b-831d-322cb8331821 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:40.597139 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-f3c8c6f3-1f1c-444b-831d-322cb8331821 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:40.599250 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f3c8c6f3-1f1c-444b-831d-322cb8331821 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:40.599733 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f3c8c6f3-1f1c-444b-831d-322cb8331821 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:40.600162 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f3c8c6f3-1f1c-444b-831d-322cb8331821 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:40.600886 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f3c8c6f3-1f1c-444b-831d-322cb8331821 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:40.601328 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f3c8c6f3-1f1c-444b-831d-322cb8331821 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:40.601781 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f3c8c6f3-1f1c-444b-831d-322cb8331821 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:40.746842 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-f3c8c6f3-1f1c-444b-831d-322cb8331821 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:40.753544 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-f3c8c6f3-1f1c-444b-831d-322cb8331821 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1523 microversion: 2.1 time: 0.165676 Aug 09 18:50:40.754108 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 113/226] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:40 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:41.463109 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-3bef7596-598d-4734-9f44-94619938f486 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:41.463814 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-3bef7596-598d-4734-9f44-94619938f486 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:41.479115 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3bef7596-598d-4734-9f44-94619938f486 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:41.480811 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3bef7596-598d-4734-9f44-94619938f486 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:41.481246 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3bef7596-598d-4734-9f44-94619938f486 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:41.481975 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3bef7596-598d-4734-9f44-94619938f486 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:41.483001 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3bef7596-598d-4734-9f44-94619938f486 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:41.483420 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3bef7596-598d-4734-9f44-94619938f486 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:41.663845 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-3bef7596-598d-4734-9f44-94619938f486 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:41.672965 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-3bef7596-598d-4734-9f44-94619938f486 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9" status: 200 len: 1368 microversion: 2.1 time: 0.213675 Aug 09 18:50:41.673580 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 114/227] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:41 2022] GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9 => generated 1368 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:41.774334 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-106322f1-f0db-4a91-9296-b9d0ba6e8b1a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:41.774983 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-106322f1-f0db-4a91-9296-b9d0ba6e8b1a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:41.782711 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-106322f1-f0db-4a91-9296-b9d0ba6e8b1a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:41.783287 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-106322f1-f0db-4a91-9296-b9d0ba6e8b1a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:41.783818 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-106322f1-f0db-4a91-9296-b9d0ba6e8b1a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:41.784529 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-106322f1-f0db-4a91-9296-b9d0ba6e8b1a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:41.784984 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-106322f1-f0db-4a91-9296-b9d0ba6e8b1a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:41.785410 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-106322f1-f0db-4a91-9296-b9d0ba6e8b1a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:41.929267 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-106322f1-f0db-4a91-9296-b9d0ba6e8b1a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:41.937376 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-106322f1-f0db-4a91-9296-b9d0ba6e8b1a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1523 microversion: 2.1 time: 0.166834 Aug 09 18:50:41.937995 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 114/228] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:41 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:42.695139 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-08a3763a-7ede-406b-adeb-837b166cf39f tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:42.695856 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-08a3763a-7ede-406b-adeb-837b166cf39f tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:42.702672 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-08a3763a-7ede-406b-adeb-837b166cf39f tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:42.703271 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-08a3763a-7ede-406b-adeb-837b166cf39f tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:42.703789 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-08a3763a-7ede-406b-adeb-837b166cf39f tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:42.704511 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-08a3763a-7ede-406b-adeb-837b166cf39f tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:42.705050 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-08a3763a-7ede-406b-adeb-837b166cf39f tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:42.705563 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-08a3763a-7ede-406b-adeb-837b166cf39f tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:42.853068 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-08a3763a-7ede-406b-adeb-837b166cf39f tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:42.861401 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-08a3763a-7ede-406b-adeb-837b166cf39f tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9" status: 200 len: 1368 microversion: 2.1 time: 0.170438 Aug 09 18:50:42.862028 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 115/229] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:42 2022] GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9 => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:42.960636 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-bf9a6891-75a7-4c65-962e-9739e65e900b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:42.961259 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-bf9a6891-75a7-4c65-962e-9739e65e900b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:42.967617 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-bf9a6891-75a7-4c65-962e-9739e65e900b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:42.968121 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-bf9a6891-75a7-4c65-962e-9739e65e900b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:42.968541 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-bf9a6891-75a7-4c65-962e-9739e65e900b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:42.969240 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-bf9a6891-75a7-4c65-962e-9739e65e900b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:42.969993 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-bf9a6891-75a7-4c65-962e-9739e65e900b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:42.970865 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-bf9a6891-75a7-4c65-962e-9739e65e900b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:43.154739 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-bf9a6891-75a7-4c65-962e-9739e65e900b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:43.164629 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-bf9a6891-75a7-4c65-962e-9739e65e900b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1523 microversion: 2.1 time: 0.208526 Aug 09 18:50:43.170287 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 115/230] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:42 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1523 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:43.883304 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-764a6025-7027-41a5-a34a-d1278f1e74d7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:43.884097 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-764a6025-7027-41a5-a34a-d1278f1e74d7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:43.890845 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-764a6025-7027-41a5-a34a-d1278f1e74d7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:43.891332 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-764a6025-7027-41a5-a34a-d1278f1e74d7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:43.891930 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-764a6025-7027-41a5-a34a-d1278f1e74d7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:43.892565 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-764a6025-7027-41a5-a34a-d1278f1e74d7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:43.893015 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-764a6025-7027-41a5-a34a-d1278f1e74d7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:43.893512 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-764a6025-7027-41a5-a34a-d1278f1e74d7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:44.032673 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-764a6025-7027-41a5-a34a-d1278f1e74d7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:44.040258 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-764a6025-7027-41a5-a34a-d1278f1e74d7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9" status: 200 len: 1368 microversion: 2.1 time: 0.160984 Aug 09 18:50:44.040847 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 116/231] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:43 2022] GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:44.186995 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-d6e9d139-2664-4ed4-8d91-6ad457df4e76 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:44.187719 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-d6e9d139-2664-4ed4-8d91-6ad457df4e76 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:44.194479 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d6e9d139-2664-4ed4-8d91-6ad457df4e76 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:44.195031 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d6e9d139-2664-4ed4-8d91-6ad457df4e76 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:44.195464 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d6e9d139-2664-4ed4-8d91-6ad457df4e76 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:44.196195 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d6e9d139-2664-4ed4-8d91-6ad457df4e76 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:44.196666 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d6e9d139-2664-4ed4-8d91-6ad457df4e76 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:44.197086 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d6e9d139-2664-4ed4-8d91-6ad457df4e76 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:44.338235 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-d6e9d139-2664-4ed4-8d91-6ad457df4e76 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:44.340490 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:50:44.348794 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-d6e9d139-2664-4ed4-8d91-6ad457df4e76 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1523 microversion: 2.1 time: 0.166205 Aug 09 18:50:44.349440 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 116/232] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:44 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:50:44.743234 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-60249737-d80a-4989-b92e-d95a31790370 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:44.743724 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-60249737-d80a-4989-b92e-d95a31790370 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:44.751232 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-60249737-d80a-4989-b92e-d95a31790370 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:44.751928 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-60249737-d80a-4989-b92e-d95a31790370 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:44.753001 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-60249737-d80a-4989-b92e-d95a31790370 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:44.756927 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-60249737-d80a-4989-b92e-d95a31790370 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:44.757458 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-60249737-d80a-4989-b92e-d95a31790370 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:44.757930 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-60249737-d80a-4989-b92e-d95a31790370 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:44.784876 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-60249737-d80a-4989-b92e-d95a31790370 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd/ips" status: 200 len: 152 microversion: 2.20 time: 0.045581 Aug 09 18:50:44.785388 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 117/233] 10.222.0.57 () {60 vars in 1289 bytes} [Tue Aug 9 18:50:44 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd/ips => generated 152 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:50:45.061245 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-dea3814e-4bdd-4c9e-885d-33eb1a52c668 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:45.062052 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-dea3814e-4bdd-4c9e-885d-33eb1a52c668 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:45.072307 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-dea3814e-4bdd-4c9e-885d-33eb1a52c668 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:45.074870 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-dea3814e-4bdd-4c9e-885d-33eb1a52c668 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:45.075332 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-dea3814e-4bdd-4c9e-885d-33eb1a52c668 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:45.076285 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-dea3814e-4bdd-4c9e-885d-33eb1a52c668 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:45.078011 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-dea3814e-4bdd-4c9e-885d-33eb1a52c668 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:45.078475 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-dea3814e-4bdd-4c9e-885d-33eb1a52c668 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:45.233631 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-dea3814e-4bdd-4c9e-885d-33eb1a52c668 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:45.241735 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-dea3814e-4bdd-4c9e-885d-33eb1a52c668 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9" status: 200 len: 1368 microversion: 2.1 time: 0.184141 Aug 09 18:50:45.241969 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 117/234] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:45 2022] GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9 => generated 1368 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:45.372197 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-0fc5a346-01ae-459b-845b-d99243afd593 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7dcbbf4-0719-4dcd-b558-a3be4636e7db"}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:50:45.378348 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-dcd52ef0-0e58-4c09-ad6e-6d49c6fb7cbb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:45.379207 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-dcd52ef0-0e58-4c09-ad6e-6d49c6fb7cbb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:45.384703 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-0fc5a346-01ae-459b-845b-d99243afd593 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:45.386745 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-dcd52ef0-0e58-4c09-ad6e-6d49c6fb7cbb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:45.387147 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-dcd52ef0-0e58-4c09-ad6e-6d49c6fb7cbb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:45.387656 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-dcd52ef0-0e58-4c09-ad6e-6d49c6fb7cbb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:45.388973 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-dcd52ef0-0e58-4c09-ad6e-6d49c6fb7cbb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:45.389551 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-dcd52ef0-0e58-4c09-ad6e-6d49c6fb7cbb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:45.390172 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-dcd52ef0-0e58-4c09-ad6e-6d49c6fb7cbb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:45.392224 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0fc5a346-01ae-459b-845b-d99243afd593 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:45.392890 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0fc5a346-01ae-459b-845b-d99243afd593 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:45.393323 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0fc5a346-01ae-459b-845b-d99243afd593 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:45.394053 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0fc5a346-01ae-459b-845b-d99243afd593 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:45.394502 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0fc5a346-01ae-459b-845b-d99243afd593 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:45.395109 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0fc5a346-01ae-459b-845b-d99243afd593 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:45.415735 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=100 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:50:45.589289 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-dcd52ef0-0e58-4c09-ad6e-6d49c6fb7cbb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:45.597416 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-dcd52ef0-0e58-4c09-ad6e-6d49c6fb7cbb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1523 microversion: 2.1 time: 0.222979 Aug 09 18:50:45.598010 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 118/235] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:45 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1523 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:46.230786 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-0fc5a346-01ae-459b-845b-d99243afd593 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "POST /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.862439 Aug 09 18:50:46.231507 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 118/236] 10.222.0.57 () {60 vars in 1323 bytes} [Tue Aug 9 18:50:45 2022] POST /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af/os-volume_attachments => generated 194 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:50:46.265379 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-076fa8f2-dc56-43c8-9115-ca9593bc0408 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:46.266594 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-076fa8f2-dc56-43c8-9115-ca9593bc0408 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:46.273247 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-076fa8f2-dc56-43c8-9115-ca9593bc0408 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:46.273697 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-076fa8f2-dc56-43c8-9115-ca9593bc0408 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:46.274122 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-076fa8f2-dc56-43c8-9115-ca9593bc0408 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:46.274818 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-076fa8f2-dc56-43c8-9115-ca9593bc0408 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:46.275264 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-076fa8f2-dc56-43c8-9115-ca9593bc0408 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:46.275711 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-076fa8f2-dc56-43c8-9115-ca9593bc0408 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:46.412622 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-076fa8f2-dc56-43c8-9115-ca9593bc0408 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:46.420276 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-076fa8f2-dc56-43c8-9115-ca9593bc0408 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9" status: 200 len: 1368 microversion: 2.1 time: 0.158715 Aug 09 18:50:46.421619 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 119/237] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:46 2022] GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:50:46.620135 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-369847d0-24fe-48f0-bde4-6f444fc97831 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:46.620822 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-369847d0-24fe-48f0-bde4-6f444fc97831 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:46.626940 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-369847d0-24fe-48f0-bde4-6f444fc97831 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:46.627420 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-369847d0-24fe-48f0-bde4-6f444fc97831 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:46.627848 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-369847d0-24fe-48f0-bde4-6f444fc97831 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:46.628537 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-369847d0-24fe-48f0-bde4-6f444fc97831 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:46.628984 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-369847d0-24fe-48f0-bde4-6f444fc97831 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:46.629502 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-369847d0-24fe-48f0-bde4-6f444fc97831 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:46.765446 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-369847d0-24fe-48f0-bde4-6f444fc97831 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:46.773057 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-369847d0-24fe-48f0-bde4-6f444fc97831 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1523 microversion: 2.1 time: 0.157209 Aug 09 18:50:46.773650 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 119/238] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:46 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:47.443189 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-ff54d742-2435-4bb2-8fa5-67f7e81bbe4e tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:47.443784 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-ff54d742-2435-4bb2-8fa5-67f7e81bbe4e tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:47.450242 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ff54d742-2435-4bb2-8fa5-67f7e81bbe4e tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:47.452459 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ff54d742-2435-4bb2-8fa5-67f7e81bbe4e tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:47.452951 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ff54d742-2435-4bb2-8fa5-67f7e81bbe4e tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:47.453751 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ff54d742-2435-4bb2-8fa5-67f7e81bbe4e tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:47.454307 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ff54d742-2435-4bb2-8fa5-67f7e81bbe4e tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:47.454712 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ff54d742-2435-4bb2-8fa5-67f7e81bbe4e tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:47.590556 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-ff54d742-2435-4bb2-8fa5-67f7e81bbe4e tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:47.598107 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-ff54d742-2435-4bb2-8fa5-67f7e81bbe4e tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9" status: 200 len: 1368 microversion: 2.1 time: 0.158983 Aug 09 18:50:47.598678 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 120/239] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:47 2022] GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:47.794385 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-ea56acab-64d4-4a0b-a212-da0fb5172eef tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:47.794998 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-ea56acab-64d4-4a0b-a212-da0fb5172eef tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:47.802280 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ea56acab-64d4-4a0b-a212-da0fb5172eef tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:47.802761 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ea56acab-64d4-4a0b-a212-da0fb5172eef tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:47.803194 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ea56acab-64d4-4a0b-a212-da0fb5172eef tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:47.803915 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ea56acab-64d4-4a0b-a212-da0fb5172eef tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:47.804369 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ea56acab-64d4-4a0b-a212-da0fb5172eef tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:47.804793 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ea56acab-64d4-4a0b-a212-da0fb5172eef tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:47.940334 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-ea56acab-64d4-4a0b-a212-da0fb5172eef tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:47.947972 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-ea56acab-64d4-4a0b-a212-da0fb5172eef tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1523 microversion: 2.1 time: 0.157430 Aug 09 18:50:47.948476 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 120/240] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:47 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:48.619479 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-79e2769b-9b50-4a8e-bb0a-400b07c69d21 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:48.620251 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-79e2769b-9b50-4a8e-bb0a-400b07c69d21 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:48.627499 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-79e2769b-9b50-4a8e-bb0a-400b07c69d21 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:48.628269 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-79e2769b-9b50-4a8e-bb0a-400b07c69d21 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:48.628704 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-79e2769b-9b50-4a8e-bb0a-400b07c69d21 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:48.629401 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-79e2769b-9b50-4a8e-bb0a-400b07c69d21 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:48.629862 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-79e2769b-9b50-4a8e-bb0a-400b07c69d21 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:48.630543 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-79e2769b-9b50-4a8e-bb0a-400b07c69d21 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:48.769109 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-79e2769b-9b50-4a8e-bb0a-400b07c69d21 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:48.776935 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-79e2769b-9b50-4a8e-bb0a-400b07c69d21 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9" status: 200 len: 1368 microversion: 2.1 time: 0.161590 Aug 09 18:50:48.777507 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 121/241] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:48 2022] GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:48.968816 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f516eebb-1b0d-4258-b541-d0bfe01d0427 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:48.970076 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-f516eebb-1b0d-4258-b541-d0bfe01d0427 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:48.979241 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f516eebb-1b0d-4258-b541-d0bfe01d0427 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:48.979772 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f516eebb-1b0d-4258-b541-d0bfe01d0427 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:48.980204 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f516eebb-1b0d-4258-b541-d0bfe01d0427 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:48.992626 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f516eebb-1b0d-4258-b541-d0bfe01d0427 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:48.992626 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f516eebb-1b0d-4258-b541-d0bfe01d0427 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:48.992626 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f516eebb-1b0d-4258-b541-d0bfe01d0427 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:49.144542 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f516eebb-1b0d-4258-b541-d0bfe01d0427 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:49.153324 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f516eebb-1b0d-4258-b541-d0bfe01d0427 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1523 microversion: 2.1 time: 0.188793 Aug 09 18:50:49.153931 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 121/242] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:48 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:49.804890 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-cee9b338-666f-4d94-b928-01b001704c06 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:49.805505 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-cee9b338-666f-4d94-b928-01b001704c06 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:49.812338 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cee9b338-666f-4d94-b928-01b001704c06 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:49.812827 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cee9b338-666f-4d94-b928-01b001704c06 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:49.813257 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cee9b338-666f-4d94-b928-01b001704c06 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:49.814049 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cee9b338-666f-4d94-b928-01b001704c06 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:49.814503 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cee9b338-666f-4d94-b928-01b001704c06 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:49.814928 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cee9b338-666f-4d94-b928-01b001704c06 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:49.957312 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-cee9b338-666f-4d94-b928-01b001704c06 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:49.964886 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-cee9b338-666f-4d94-b928-01b001704c06 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9" status: 200 len: 1368 microversion: 2.1 time: 0.164320 Aug 09 18:50:49.965448 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 122/243] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:49 2022] GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:50.179275 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-cf0239cc-a1a3-44a6-9e2d-c8f16486c01f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:50.179867 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-cf0239cc-a1a3-44a6-9e2d-c8f16486c01f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:50.182287 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=56 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:50:50.187507 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cf0239cc-a1a3-44a6-9e2d-c8f16486c01f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:50.187991 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cf0239cc-a1a3-44a6-9e2d-c8f16486c01f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:50.188411 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cf0239cc-a1a3-44a6-9e2d-c8f16486c01f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:50.189097 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cf0239cc-a1a3-44a6-9e2d-c8f16486c01f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:50.189554 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cf0239cc-a1a3-44a6-9e2d-c8f16486c01f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:50.189973 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cf0239cc-a1a3-44a6-9e2d-c8f16486c01f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:50.324335 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-cf0239cc-a1a3-44a6-9e2d-c8f16486c01f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:50.332544 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-cf0239cc-a1a3-44a6-9e2d-c8f16486c01f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1523 microversion: 2.1 time: 0.157144 Aug 09 18:50:50.333105 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 122/244] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:50 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:50.481127 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-49ec0acb-44c7-4882-9ef9-8e5f582f7f27 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:50:50.481698 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-49ec0acb-44c7-4882-9ef9-8e5f582f7f27 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:50.488522 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-49ec0acb-44c7-4882-9ef9-8e5f582f7f27 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:50.489249 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-49ec0acb-44c7-4882-9ef9-8e5f582f7f27 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:50.489882 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-49ec0acb-44c7-4882-9ef9-8e5f582f7f27 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:50.490609 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-49ec0acb-44c7-4882-9ef9-8e5f582f7f27 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:50.491073 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-49ec0acb-44c7-4882-9ef9-8e5f582f7f27 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:50.491500 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-49ec0acb-44c7-4882-9ef9-8e5f582f7f27 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:50.515537 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.objects.instance [None req-49ec0acb-44c7-4882-9ef9-8e5f582f7f27 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lazy-loading 'flavor' on Instance uuid 22aac118-db08-4aca-a5e7-3f2cad5e49fd {{(pid=124726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:50:50.987722 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-0cfade1d-3463-4ba6-8cc4-c7f8e8401df6 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:50.988258 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-0cfade1d-3463-4ba6-8cc4-c7f8e8401df6 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:50.994226 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0cfade1d-3463-4ba6-8cc4-c7f8e8401df6 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:50.994705 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0cfade1d-3463-4ba6-8cc4-c7f8e8401df6 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:50.995132 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0cfade1d-3463-4ba6-8cc4-c7f8e8401df6 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:50.995827 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0cfade1d-3463-4ba6-8cc4-c7f8e8401df6 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:50.996362 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0cfade1d-3463-4ba6-8cc4-c7f8e8401df6 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:50.996675 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0cfade1d-3463-4ba6-8cc4-c7f8e8401df6 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:51.138490 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-0cfade1d-3463-4ba6-8cc4-c7f8e8401df6 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:51.146524 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-0cfade1d-3463-4ba6-8cc4-c7f8e8401df6 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9" status: 200 len: 1368 microversion: 2.1 time: 0.163326 Aug 09 18:50:51.147102 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 123/245] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:50 2022] GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:50:51.352720 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e9d9bb15-e0ec-40de-b4c9-5838bdede1fa tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:51.353354 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e9d9bb15-e0ec-40de-b4c9-5838bdede1fa tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:51.359673 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e9d9bb15-e0ec-40de-b4c9-5838bdede1fa tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:51.360122 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e9d9bb15-e0ec-40de-b4c9-5838bdede1fa tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:51.360556 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e9d9bb15-e0ec-40de-b4c9-5838bdede1fa tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:51.361247 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e9d9bb15-e0ec-40de-b4c9-5838bdede1fa tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:51.361725 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e9d9bb15-e0ec-40de-b4c9-5838bdede1fa tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:51.362144 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e9d9bb15-e0ec-40de-b4c9-5838bdede1fa tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:51.501239 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e9d9bb15-e0ec-40de-b4c9-5838bdede1fa tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:51.508692 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e9d9bb15-e0ec-40de-b4c9-5838bdede1fa tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1523 microversion: 2.1 time: 0.159845 Aug 09 18:50:51.514520 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 124/246] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:51 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:50:52.168970 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d27889cb-8700-431d-820a-fbf6e4a128ea tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:52.169602 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-d27889cb-8700-431d-820a-fbf6e4a128ea tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:52.183992 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d27889cb-8700-431d-820a-fbf6e4a128ea tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:52.184513 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d27889cb-8700-431d-820a-fbf6e4a128ea tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:52.185008 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d27889cb-8700-431d-820a-fbf6e4a128ea tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:52.185905 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d27889cb-8700-431d-820a-fbf6e4a128ea tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:52.187022 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d27889cb-8700-431d-820a-fbf6e4a128ea tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:52.187503 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d27889cb-8700-431d-820a-fbf6e4a128ea tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:52.341187 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d27889cb-8700-431d-820a-fbf6e4a128ea tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:52.350705 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-d27889cb-8700-431d-820a-fbf6e4a128ea tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9" status: 200 len: 1368 microversion: 2.1 time: 0.185687 Aug 09 18:50:52.351288 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 125/247] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:52 2022] GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9 => generated 1368 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:52.532186 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f06b369c-0f5d-4965-9b78-fe4f0dd78f86 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:52.532997 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-f06b369c-0f5d-4965-9b78-fe4f0dd78f86 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:52.541647 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f06b369c-0f5d-4965-9b78-fe4f0dd78f86 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:52.542462 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f06b369c-0f5d-4965-9b78-fe4f0dd78f86 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:52.542980 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f06b369c-0f5d-4965-9b78-fe4f0dd78f86 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:52.543815 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f06b369c-0f5d-4965-9b78-fe4f0dd78f86 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:52.544337 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f06b369c-0f5d-4965-9b78-fe4f0dd78f86 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:52.544838 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f06b369c-0f5d-4965-9b78-fe4f0dd78f86 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:52.711939 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f06b369c-0f5d-4965-9b78-fe4f0dd78f86 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:52.720717 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f06b369c-0f5d-4965-9b78-fe4f0dd78f86 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1523 microversion: 2.1 time: 0.194159 Aug 09 18:50:52.725494 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 126/248] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:52 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:50:53.372165 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-8e155cfc-18c6-4583-b4d6-59feeb5b7b2d tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:53.372809 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-8e155cfc-18c6-4583-b4d6-59feeb5b7b2d tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:53.380053 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8e155cfc-18c6-4583-b4d6-59feeb5b7b2d tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:53.380537 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8e155cfc-18c6-4583-b4d6-59feeb5b7b2d tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:53.381006 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8e155cfc-18c6-4583-b4d6-59feeb5b7b2d tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:53.381705 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8e155cfc-18c6-4583-b4d6-59feeb5b7b2d tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:53.382162 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8e155cfc-18c6-4583-b4d6-59feeb5b7b2d tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:53.382583 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8e155cfc-18c6-4583-b4d6-59feeb5b7b2d tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:53.438707 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-49ec0acb-44c7-4882-9ef9-8e5f582f7f27 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "POST /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd/action" status: 202 len: 0 microversion: 2.20 time: 2.961254 Aug 09 18:50:53.439316 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 123/249] 10.222.0.57 () {62 vars in 1319 bytes} [Tue Aug 9 18:50:50 2022] POST /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd/action => generated 0 bytes in 2963 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:50:53.449885 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-0b6c350a-cd3a-4fb9-90ef-9c7440fa6197 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:53.450581 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-0b6c350a-cd3a-4fb9-90ef-9c7440fa6197 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:53.462764 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0b6c350a-cd3a-4fb9-90ef-9c7440fa6197 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:53.463207 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0b6c350a-cd3a-4fb9-90ef-9c7440fa6197 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:53.463816 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0b6c350a-cd3a-4fb9-90ef-9c7440fa6197 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:53.466014 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0b6c350a-cd3a-4fb9-90ef-9c7440fa6197 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:53.466632 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0b6c350a-cd3a-4fb9-90ef-9c7440fa6197 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:53.467063 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0b6c350a-cd3a-4fb9-90ef-9c7440fa6197 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:53.576607 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-8e155cfc-18c6-4583-b4d6-59feeb5b7b2d tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:53.585783 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-8e155cfc-18c6-4583-b4d6-59feeb5b7b2d tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9" status: 200 len: 1368 microversion: 2.1 time: 0.217588 Aug 09 18:50:53.586696 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 127/250] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:53 2022] GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9 => generated 1368 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:53.679869 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-0b6c350a-cd3a-4fb9-90ef-9c7440fa6197 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:53.691213 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-0b6c350a-cd3a-4fb9-90ef-9c7440fa6197 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:53.693509 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-0b6c350a-cd3a-4fb9-90ef-9c7440fa6197 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:53.694893 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-0b6c350a-cd3a-4fb9-90ef-9c7440fa6197 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1722 microversion: 2.20 time: 0.251104 Aug 09 18:50:53.695598 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 124/251] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:50:53 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1722 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:50:53.741346 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-1f728ae1-83f1-4eb6-a570-caaa42ca9c15 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:53.742096 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-1f728ae1-83f1-4eb6-a570-caaa42ca9c15 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:53.747927 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1f728ae1-83f1-4eb6-a570-caaa42ca9c15 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:53.748411 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1f728ae1-83f1-4eb6-a570-caaa42ca9c15 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:53.749387 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1f728ae1-83f1-4eb6-a570-caaa42ca9c15 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:53.750127 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1f728ae1-83f1-4eb6-a570-caaa42ca9c15 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:53.750578 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1f728ae1-83f1-4eb6-a570-caaa42ca9c15 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:53.752927 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1f728ae1-83f1-4eb6-a570-caaa42ca9c15 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:53.890626 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1f728ae1-83f1-4eb6-a570-caaa42ca9c15 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:53.898069 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-1f728ae1-83f1-4eb6-a570-caaa42ca9c15 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1523 microversion: 2.1 time: 0.160537 Aug 09 18:50:53.898639 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 128/252] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:53 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:54.609339 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-f753e49b-424c-4b02-b9ad-0556f1f237d6 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:54.610604 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-f753e49b-424c-4b02-b9ad-0556f1f237d6 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:54.617963 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f753e49b-424c-4b02-b9ad-0556f1f237d6 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:54.618451 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f753e49b-424c-4b02-b9ad-0556f1f237d6 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:54.619045 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f753e49b-424c-4b02-b9ad-0556f1f237d6 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:54.619754 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f753e49b-424c-4b02-b9ad-0556f1f237d6 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:54.620209 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f753e49b-424c-4b02-b9ad-0556f1f237d6 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:54.620633 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f753e49b-424c-4b02-b9ad-0556f1f237d6 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:54.721816 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f3c58cb9-2156-448a-ad38-7dd46b1e3e4f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:54.721816 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-f3c58cb9-2156-448a-ad38-7dd46b1e3e4f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:54.729075 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f3c58cb9-2156-448a-ad38-7dd46b1e3e4f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:54.729932 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f3c58cb9-2156-448a-ad38-7dd46b1e3e4f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:54.730234 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f3c58cb9-2156-448a-ad38-7dd46b1e3e4f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:54.731256 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f3c58cb9-2156-448a-ad38-7dd46b1e3e4f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:54.731861 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f3c58cb9-2156-448a-ad38-7dd46b1e3e4f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:54.732620 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f3c58cb9-2156-448a-ad38-7dd46b1e3e4f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:54.776450 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-f753e49b-424c-4b02-b9ad-0556f1f237d6 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:54.790636 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-f753e49b-424c-4b02-b9ad-0556f1f237d6 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9" status: 200 len: 1368 microversion: 2.1 time: 0.180778 Aug 09 18:50:54.790636 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 125/253] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:54 2022] GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9 => generated 1368 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:54.870427 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f3c58cb9-2156-448a-ad38-7dd46b1e3e4f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:54.878582 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f3c58cb9-2156-448a-ad38-7dd46b1e3e4f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:54.880311 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f3c58cb9-2156-448a-ad38-7dd46b1e3e4f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:54.881235 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f3c58cb9-2156-448a-ad38-7dd46b1e3e4f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1722 microversion: 2.20 time: 0.166146 Aug 09 18:50:54.881824 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 129/254] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:50:54 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:50:54.918644 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-0053006f-6963-45b6-b2e8-2ea9499d0470 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:54.919251 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-0053006f-6963-45b6-b2e8-2ea9499d0470 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:54.921180 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:50:54.926263 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0053006f-6963-45b6-b2e8-2ea9499d0470 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:54.926742 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0053006f-6963-45b6-b2e8-2ea9499d0470 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:54.927170 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0053006f-6963-45b6-b2e8-2ea9499d0470 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:54.927879 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0053006f-6963-45b6-b2e8-2ea9499d0470 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:54.928327 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0053006f-6963-45b6-b2e8-2ea9499d0470 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:54.928741 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0053006f-6963-45b6-b2e8-2ea9499d0470 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:55.063293 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-0053006f-6963-45b6-b2e8-2ea9499d0470 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:55.071570 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-0053006f-6963-45b6-b2e8-2ea9499d0470 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1523 microversion: 2.1 time: 0.156688 Aug 09 18:50:55.072137 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 126/255] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:54 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:55.810197 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5741f116-91ca-4cff-8294-37c4dcd4870a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:55.810930 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-5741f116-91ca-4cff-8294-37c4dcd4870a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:55.818113 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5741f116-91ca-4cff-8294-37c4dcd4870a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:55.818654 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5741f116-91ca-4cff-8294-37c4dcd4870a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:55.819182 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5741f116-91ca-4cff-8294-37c4dcd4870a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:55.819820 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5741f116-91ca-4cff-8294-37c4dcd4870a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:55.820267 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5741f116-91ca-4cff-8294-37c4dcd4870a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:55.820688 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5741f116-91ca-4cff-8294-37c4dcd4870a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:55.905014 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-0df8552d-c8e8-4d97-b70a-bb63bc8f83ec tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:55.905674 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-0df8552d-c8e8-4d97-b70a-bb63bc8f83ec tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:55.912353 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0df8552d-c8e8-4d97-b70a-bb63bc8f83ec tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:55.912839 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0df8552d-c8e8-4d97-b70a-bb63bc8f83ec tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:55.913276 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0df8552d-c8e8-4d97-b70a-bb63bc8f83ec tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:55.914012 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0df8552d-c8e8-4d97-b70a-bb63bc8f83ec tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:55.914467 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0df8552d-c8e8-4d97-b70a-bb63bc8f83ec tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:55.914927 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0df8552d-c8e8-4d97-b70a-bb63bc8f83ec tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:55.959881 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5741f116-91ca-4cff-8294-37c4dcd4870a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:55.971160 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-5741f116-91ca-4cff-8294-37c4dcd4870a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9" status: 200 len: 1368 microversion: 2.1 time: 0.164809 Aug 09 18:50:55.973284 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 130/256] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:55 2022] GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:56.055886 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-0df8552d-c8e8-4d97-b70a-bb63bc8f83ec tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:56.064534 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-0df8552d-c8e8-4d97-b70a-bb63bc8f83ec tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:56.066083 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-0df8552d-c8e8-4d97-b70a-bb63bc8f83ec tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:56.067291 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-0df8552d-c8e8-4d97-b70a-bb63bc8f83ec tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1722 microversion: 2.20 time: 0.166729 Aug 09 18:50:56.067847 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 127/257] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:50:55 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:50:56.098116 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-7efee60c-9e20-4670-b26c-72d9eed81bab tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:56.098116 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-7efee60c-9e20-4670-b26c-72d9eed81bab tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:56.100790 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7efee60c-9e20-4670-b26c-72d9eed81bab tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:56.100790 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7efee60c-9e20-4670-b26c-72d9eed81bab tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:56.100790 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7efee60c-9e20-4670-b26c-72d9eed81bab tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:56.102471 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7efee60c-9e20-4670-b26c-72d9eed81bab tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:56.102471 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7efee60c-9e20-4670-b26c-72d9eed81bab tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:56.102471 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7efee60c-9e20-4670-b26c-72d9eed81bab tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:56.243751 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-7efee60c-9e20-4670-b26c-72d9eed81bab tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:56.251415 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-7efee60c-9e20-4670-b26c-72d9eed81bab tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1523 microversion: 2.1 time: 0.162798 Aug 09 18:50:56.252004 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 131/258] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:56 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:56.976220 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-9264bee7-393e-4667-a977-894665926b15 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:50:56.983067 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9264bee7-393e-4667-a977-894665926b15 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:56.983928 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9264bee7-393e-4667-a977-894665926b15 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:56.984364 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9264bee7-393e-4667-a977-894665926b15 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:56.994092 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-402fbc93-b2f3-4130-a3c8-8897473e82ce tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:56.995996 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-402fbc93-b2f3-4130-a3c8-8897473e82ce tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:57.001942 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-402fbc93-b2f3-4130-a3c8-8897473e82ce tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:57.002430 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-402fbc93-b2f3-4130-a3c8-8897473e82ce tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:57.002861 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-402fbc93-b2f3-4130-a3c8-8897473e82ce tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:57.003587 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-402fbc93-b2f3-4130-a3c8-8897473e82ce tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:57.004010 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-402fbc93-b2f3-4130-a3c8-8897473e82ce tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:57.004435 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-402fbc93-b2f3-4130-a3c8-8897473e82ce tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:57.049336 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-9264bee7-393e-4667-a977-894665926b15 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Going to try to stop instance {{(pid=124726) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 09 18:50:57.167783 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-402fbc93-b2f3-4130-a3c8-8897473e82ce tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:57.175456 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-402fbc93-b2f3-4130-a3c8-8897473e82ce tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9" status: 200 len: 1368 microversion: 2.1 time: 0.185130 Aug 09 18:50:57.176042 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 132/259] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:56 2022] GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9 => generated 1368 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:50:57.180565 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-ba905f1d-ef96-4980-8be3-0e8ce125a972 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:57.181355 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-ba905f1d-ef96-4980-8be3-0e8ce125a972 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:57.187993 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ba905f1d-ef96-4980-8be3-0e8ce125a972 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:57.188479 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ba905f1d-ef96-4980-8be3-0e8ce125a972 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:57.188901 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ba905f1d-ef96-4980-8be3-0e8ce125a972 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:57.189621 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ba905f1d-ef96-4980-8be3-0e8ce125a972 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:57.190241 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ba905f1d-ef96-4980-8be3-0e8ce125a972 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:57.190679 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ba905f1d-ef96-4980-8be3-0e8ce125a972 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:57.229194 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-9264bee7-393e-4667-a977-894665926b15 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "POST /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af/action" status: 202 len: 0 microversion: 2.1 time: 0.258625 Aug 09 18:50:57.230643 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 128/260] 10.222.0.57 () {60 vars in 1278 bytes} [Tue Aug 9 18:50:56 2022] POST /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:50:57.257881 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-a175ac06-9402-4d3a-8476-cc974968f0e2 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:57.268442 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-a175ac06-9402-4d3a-8476-cc974968f0e2 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:57.281040 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a175ac06-9402-4d3a-8476-cc974968f0e2 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:57.283665 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a175ac06-9402-4d3a-8476-cc974968f0e2 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:57.284352 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a175ac06-9402-4d3a-8476-cc974968f0e2 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:57.285233 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a175ac06-9402-4d3a-8476-cc974968f0e2 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:57.285896 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a175ac06-9402-4d3a-8476-cc974968f0e2 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:57.286363 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a175ac06-9402-4d3a-8476-cc974968f0e2 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:57.332453 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-ba905f1d-ef96-4980-8be3-0e8ce125a972 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:57.335943 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:50:57.341186 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-ba905f1d-ef96-4980-8be3-0e8ce125a972 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:57.342840 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-ba905f1d-ef96-4980-8be3-0e8ce125a972 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:57.344075 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-ba905f1d-ef96-4980-8be3-0e8ce125a972 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1722 microversion: 2.20 time: 0.167102 Aug 09 18:50:57.344652 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 133/261] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:50:57 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:50:57.349291 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-baff89e0-2ef9-4aad-ba70-40758a335707 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:57.350158 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-baff89e0-2ef9-4aad-ba70-40758a335707 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:57.360401 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-baff89e0-2ef9-4aad-ba70-40758a335707 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:57.360948 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-baff89e0-2ef9-4aad-ba70-40758a335707 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:57.361329 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-baff89e0-2ef9-4aad-ba70-40758a335707 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:57.362097 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-baff89e0-2ef9-4aad-ba70-40758a335707 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:57.362551 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-baff89e0-2ef9-4aad-ba70-40758a335707 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:57.362972 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-baff89e0-2ef9-4aad-ba70-40758a335707 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:57.445115 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-a175ac06-9402-4d3a-8476-cc974968f0e2 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:57.456231 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-a175ac06-9402-4d3a-8476-cc974968f0e2 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1723 microversion: 2.1 time: 0.202389 Aug 09 18:50:57.462523 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 129/262] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:57 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:57.518152 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-baff89e0-2ef9-4aad-ba70-40758a335707 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:57.525964 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-baff89e0-2ef9-4aad-ba70-40758a335707 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1523 microversion: 2.1 time: 0.180239 Aug 09 18:50:57.526552 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 134/263] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:57 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:58.196849 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-12d4cef5-08bc-4cda-a975-bf7d9604e916 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:58.197486 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-12d4cef5-08bc-4cda-a975-bf7d9604e916 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:58.204723 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-12d4cef5-08bc-4cda-a975-bf7d9604e916 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:58.205206 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-12d4cef5-08bc-4cda-a975-bf7d9604e916 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:58.205672 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-12d4cef5-08bc-4cda-a975-bf7d9604e916 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:58.206365 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-12d4cef5-08bc-4cda-a975-bf7d9604e916 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:58.206814 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-12d4cef5-08bc-4cda-a975-bf7d9604e916 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:58.207234 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-12d4cef5-08bc-4cda-a975-bf7d9604e916 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:58.222832 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:50:58.341071 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-12d4cef5-08bc-4cda-a975-bf7d9604e916 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:58.349994 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-12d4cef5-08bc-4cda-a975-bf7d9604e916 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9" status: 200 len: 1368 microversion: 2.1 time: 0.156784 Aug 09 18:50:58.350591 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 130/264] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:58 2022] GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:58.368133 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-bd57562d-d3b4-4676-adc1-ca08383f9439 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:58.368737 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-bd57562d-d3b4-4676-adc1-ca08383f9439 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:58.376075 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bd57562d-d3b4-4676-adc1-ca08383f9439 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:58.376557 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bd57562d-d3b4-4676-adc1-ca08383f9439 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:58.376989 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bd57562d-d3b4-4676-adc1-ca08383f9439 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:58.377706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bd57562d-d3b4-4676-adc1-ca08383f9439 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:58.383527 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bd57562d-d3b4-4676-adc1-ca08383f9439 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:58.383527 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bd57562d-d3b4-4676-adc1-ca08383f9439 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:58.481505 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-266607f6-13fa-48e1-bb18-2a638e68008c tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:58.482910 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-266607f6-13fa-48e1-bb18-2a638e68008c tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:58.492345 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-266607f6-13fa-48e1-bb18-2a638e68008c tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:58.493160 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-266607f6-13fa-48e1-bb18-2a638e68008c tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:58.493907 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-266607f6-13fa-48e1-bb18-2a638e68008c tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:58.495096 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-266607f6-13fa-48e1-bb18-2a638e68008c tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:58.495846 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-266607f6-13fa-48e1-bb18-2a638e68008c tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:58.496559 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-266607f6-13fa-48e1-bb18-2a638e68008c tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:58.519444 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-bd57562d-d3b4-4676-adc1-ca08383f9439 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:58.528074 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-bd57562d-d3b4-4676-adc1-ca08383f9439 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:58.529630 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-bd57562d-d3b4-4676-adc1-ca08383f9439 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:58.542180 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-bd57562d-d3b4-4676-adc1-ca08383f9439 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1722 microversion: 2.20 time: 0.166998 Aug 09 18:50:58.542180 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 135/265] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:50:58 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:50:58.547435 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-3e591e8b-1b5c-4295-a1af-bcfbedad7eb2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:58.548086 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-3e591e8b-1b5c-4295-a1af-bcfbedad7eb2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:58.554277 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3e591e8b-1b5c-4295-a1af-bcfbedad7eb2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:58.554854 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3e591e8b-1b5c-4295-a1af-bcfbedad7eb2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:58.555293 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3e591e8b-1b5c-4295-a1af-bcfbedad7eb2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:58.556061 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3e591e8b-1b5c-4295-a1af-bcfbedad7eb2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:58.556512 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3e591e8b-1b5c-4295-a1af-bcfbedad7eb2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:58.556932 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3e591e8b-1b5c-4295-a1af-bcfbedad7eb2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:58.642332 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-266607f6-13fa-48e1-bb18-2a638e68008c tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:58.650542 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-266607f6-13fa-48e1-bb18-2a638e68008c tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1723 microversion: 2.1 time: 0.175618 Aug 09 18:50:58.651140 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 131/266] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:58 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:58.696347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-3e591e8b-1b5c-4295-a1af-bcfbedad7eb2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:58.704349 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-3e591e8b-1b5c-4295-a1af-bcfbedad7eb2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1523 microversion: 2.1 time: 0.160866 Aug 09 18:50:58.704928 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 136/267] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:58 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:50:59.330732 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-fde25895-69ff-4c65-8761-e42e9434a668 req-ab7ed352-0ce6-4edb-ab4b-c371ad713d28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "743aafc6-1787-4c6e-be09-3b460a00d5e9", "name": "network-vif-plugged", "status": "completed", "tag": "2a32c700-6fce-4e74-b894-56a5eba16aed"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:50:59.340468 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-fde25895-69ff-4c65-8761-e42e9434a668 req-ab7ed352-0ce6-4edb-ab4b-c371ad713d28 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:59.340945 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-fde25895-69ff-4c65-8761-e42e9434a668 req-ab7ed352-0ce6-4edb-ab4b-c371ad713d28 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:59.341376 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-fde25895-69ff-4c65-8761-e42e9434a668 req-ab7ed352-0ce6-4edb-ab4b-c371ad713d28 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:59.351997 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-fde25895-69ff-4c65-8761-e42e9434a668 req-ab7ed352-0ce6-4edb-ab4b-c371ad713d28 service nova] Creating event network-vif-plugged:2a32c700-6fce-4e74-b894-56a5eba16aed for instance 743aafc6-1787-4c6e-be09-3b460a00d5e9 on hv-cinder-82660 Aug 09 18:50:59.356902 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-fde25895-69ff-4c65-8761-e42e9434a668 req-ab7ed352-0ce6-4edb-ab4b-c371ad713d28 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030593 Aug 09 18:50:59.357485 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 132/268] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:50:59.370680 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-ff764758-2828-4c65-b99f-6b7ac9cff7f9 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:59.371372 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-ff764758-2828-4c65-b99f-6b7ac9cff7f9 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:59.378331 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ff764758-2828-4c65-b99f-6b7ac9cff7f9 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:59.382726 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ff764758-2828-4c65-b99f-6b7ac9cff7f9 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:59.382726 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ff764758-2828-4c65-b99f-6b7ac9cff7f9 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:59.382726 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ff764758-2828-4c65-b99f-6b7ac9cff7f9 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:59.382726 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ff764758-2828-4c65-b99f-6b7ac9cff7f9 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:59.383191 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ff764758-2828-4c65-b99f-6b7ac9cff7f9 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:59.532828 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-ff764758-2828-4c65-b99f-6b7ac9cff7f9 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:59.540367 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-ff764758-2828-4c65-b99f-6b7ac9cff7f9 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9" status: 200 len: 1368 microversion: 2.1 time: 0.173616 Aug 09 18:50:59.540952 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 137/269] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:59 2022] GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9 => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:50:59.560025 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-ef6685e7-d79b-4660-9ab0-a915b838c2d6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:59.560718 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-ef6685e7-d79b-4660-9ab0-a915b838c2d6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:59.568376 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ef6685e7-d79b-4660-9ab0-a915b838c2d6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:59.568858 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ef6685e7-d79b-4660-9ab0-a915b838c2d6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:59.569282 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ef6685e7-d79b-4660-9ab0-a915b838c2d6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:59.570008 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ef6685e7-d79b-4660-9ab0-a915b838c2d6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:59.570457 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ef6685e7-d79b-4660-9ab0-a915b838c2d6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:59.570874 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ef6685e7-d79b-4660-9ab0-a915b838c2d6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:59.677170 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-3fa4df7d-4492-4bd6-bb12-31893021b30b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:59.677939 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-3fa4df7d-4492-4bd6-bb12-31893021b30b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:59.683951 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3fa4df7d-4492-4bd6-bb12-31893021b30b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:59.686981 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3fa4df7d-4492-4bd6-bb12-31893021b30b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:59.686981 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3fa4df7d-4492-4bd6-bb12-31893021b30b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:59.686981 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3fa4df7d-4492-4bd6-bb12-31893021b30b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:59.686981 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3fa4df7d-4492-4bd6-bb12-31893021b30b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:59.687401 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3fa4df7d-4492-4bd6-bb12-31893021b30b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:59.739011 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-ef6685e7-d79b-4660-9ab0-a915b838c2d6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:59.747462 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-ef6685e7-d79b-4660-9ab0-a915b838c2d6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:59.749170 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-ef6685e7-d79b-4660-9ab0-a915b838c2d6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:59.750440 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-ef6685e7-d79b-4660-9ab0-a915b838c2d6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1722 microversion: 2.20 time: 0.194638 Aug 09 18:50:59.751095 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 133/270] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:50:59 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:50:59.755615 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-5db9a3e9-ac49-4cf2-b6f4-22bdba546762 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:50:59.756450 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-5db9a3e9-ac49-4cf2-b6f4-22bdba546762 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:50:59.766533 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5db9a3e9-ac49-4cf2-b6f4-22bdba546762 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:59.767688 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5db9a3e9-ac49-4cf2-b6f4-22bdba546762 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:59.768431 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5db9a3e9-ac49-4cf2-b6f4-22bdba546762 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:59.769427 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5db9a3e9-ac49-4cf2-b6f4-22bdba546762 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:50:59.770169 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5db9a3e9-ac49-4cf2-b6f4-22bdba546762 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:50:59.770865 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5db9a3e9-ac49-4cf2-b6f4-22bdba546762 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:50:59.849898 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-3fa4df7d-4492-4bd6-bb12-31893021b30b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:59.860114 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-3fa4df7d-4492-4bd6-bb12-31893021b30b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1723 microversion: 2.1 time: 0.186946 Aug 09 18:50:59.860821 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 138/271] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:59 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:50:59.933389 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-5db9a3e9-ac49-4cf2-b6f4-22bdba546762 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:50:59.940905 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-5db9a3e9-ac49-4cf2-b6f4-22bdba546762 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1523 microversion: 2.1 time: 0.188682 Aug 09 18:50:59.943398 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 134/272] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:50:59 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:00.562714 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e4476cca-09ce-4dcb-850d-2c1ef0ca3616 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:00.563325 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e4476cca-09ce-4dcb-850d-2c1ef0ca3616 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:00.570432 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e4476cca-09ce-4dcb-850d-2c1ef0ca3616 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:00.570920 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e4476cca-09ce-4dcb-850d-2c1ef0ca3616 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:00.571388 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e4476cca-09ce-4dcb-850d-2c1ef0ca3616 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:00.572080 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e4476cca-09ce-4dcb-850d-2c1ef0ca3616 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:00.572732 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e4476cca-09ce-4dcb-850d-2c1ef0ca3616 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:00.573159 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e4476cca-09ce-4dcb-850d-2c1ef0ca3616 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:00.710112 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e4476cca-09ce-4dcb-850d-2c1ef0ca3616 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:00.717560 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e4476cca-09ce-4dcb-850d-2c1ef0ca3616 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9" status: 200 len: 1368 microversion: 2.1 time: 0.159230 Aug 09 18:51:00.718139 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 139/273] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:00 2022] GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:00.780377 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-632b8335-19a2-4179-922a-2242768a3a59 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:00.781513 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-632b8335-19a2-4179-922a-2242768a3a59 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:00.788642 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-632b8335-19a2-4179-922a-2242768a3a59 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:00.789128 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-632b8335-19a2-4179-922a-2242768a3a59 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:00.789583 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-632b8335-19a2-4179-922a-2242768a3a59 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:00.790343 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-632b8335-19a2-4179-922a-2242768a3a59 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:00.790786 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-632b8335-19a2-4179-922a-2242768a3a59 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:00.791205 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-632b8335-19a2-4179-922a-2242768a3a59 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:00.881564 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-de53f8f4-4193-4a81-9e51-40f02d3d88fa tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:00.882216 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-de53f8f4-4193-4a81-9e51-40f02d3d88fa tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:00.888277 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-de53f8f4-4193-4a81-9e51-40f02d3d88fa tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:00.893374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-de53f8f4-4193-4a81-9e51-40f02d3d88fa tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:00.893374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-de53f8f4-4193-4a81-9e51-40f02d3d88fa tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:00.893374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-de53f8f4-4193-4a81-9e51-40f02d3d88fa tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:00.893374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-de53f8f4-4193-4a81-9e51-40f02d3d88fa tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:00.893785 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-de53f8f4-4193-4a81-9e51-40f02d3d88fa tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:00.938267 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-632b8335-19a2-4179-922a-2242768a3a59 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:00.946593 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-632b8335-19a2-4179-922a-2242768a3a59 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:00.948124 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-632b8335-19a2-4179-922a-2242768a3a59 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:00.949284 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-632b8335-19a2-4179-922a-2242768a3a59 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1722 microversion: 2.20 time: 0.176749 Aug 09 18:51:00.949874 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 135/274] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:00 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:51:00.961722 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-72617134-f09e-45bf-a5e5-f2ac0561fcfb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:00.962665 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-72617134-f09e-45bf-a5e5-f2ac0561fcfb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:00.968690 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-72617134-f09e-45bf-a5e5-f2ac0561fcfb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:00.969168 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-72617134-f09e-45bf-a5e5-f2ac0561fcfb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:00.973549 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-72617134-f09e-45bf-a5e5-f2ac0561fcfb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:00.973549 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-72617134-f09e-45bf-a5e5-f2ac0561fcfb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:00.973549 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-72617134-f09e-45bf-a5e5-f2ac0561fcfb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:00.973549 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-72617134-f09e-45bf-a5e5-f2ac0561fcfb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:01.029923 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-de53f8f4-4193-4a81-9e51-40f02d3d88fa tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:01.038411 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-de53f8f4-4193-4a81-9e51-40f02d3d88fa tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1723 microversion: 2.1 time: 0.160872 Aug 09 18:51:01.038986 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 140/275] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:00 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:01.113809 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-72617134-f09e-45bf-a5e5-f2ac0561fcfb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:01.121502 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-72617134-f09e-45bf-a5e5-f2ac0561fcfb tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1523 microversion: 2.1 time: 0.163482 Aug 09 18:51:01.124376 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 136/276] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:00 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:51:01.738703 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-3f93eeb3-0562-4d25-b677-09de2502a1e1 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:01.739518 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-3f93eeb3-0562-4d25-b677-09de2502a1e1 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:01.746197 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3f93eeb3-0562-4d25-b677-09de2502a1e1 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:01.750119 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3f93eeb3-0562-4d25-b677-09de2502a1e1 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:01.750119 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3f93eeb3-0562-4d25-b677-09de2502a1e1 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:01.750119 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3f93eeb3-0562-4d25-b677-09de2502a1e1 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:01.750119 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3f93eeb3-0562-4d25-b677-09de2502a1e1 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:01.750479 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3f93eeb3-0562-4d25-b677-09de2502a1e1 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:01.899628 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-3f93eeb3-0562-4d25-b677-09de2502a1e1 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:01.908839 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-3f93eeb3-0562-4d25-b677-09de2502a1e1 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9" status: 200 len: 1559 microversion: 2.1 time: 0.174160 Aug 09 18:51:01.909579 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 141/277] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:01 2022] GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:01.939381 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-1e0acefc-abb2-4e5c-b977-83d94ebb6f0b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:01.939381 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-1e0acefc-abb2-4e5c-b977-83d94ebb6f0b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:01.939381 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1e0acefc-abb2-4e5c-b977-83d94ebb6f0b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:01.939381 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1e0acefc-abb2-4e5c-b977-83d94ebb6f0b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:01.940307 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1e0acefc-abb2-4e5c-b977-83d94ebb6f0b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:01.940307 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1e0acefc-abb2-4e5c-b977-83d94ebb6f0b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:01.940307 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1e0acefc-abb2-4e5c-b977-83d94ebb6f0b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:01.940713 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1e0acefc-abb2-4e5c-b977-83d94ebb6f0b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:01.974375 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-6bbed699-87c0-41f6-9959-294e9f866ef1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:01.975044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-6bbed699-87c0-41f6-9959-294e9f866ef1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:01.981302 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6bbed699-87c0-41f6-9959-294e9f866ef1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:01.981894 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6bbed699-87c0-41f6-9959-294e9f866ef1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:01.982394 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6bbed699-87c0-41f6-9959-294e9f866ef1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:01.983197 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6bbed699-87c0-41f6-9959-294e9f866ef1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:01.983708 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6bbed699-87c0-41f6-9959-294e9f866ef1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:01.984543 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6bbed699-87c0-41f6-9959-294e9f866ef1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:02.028182 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-1e0acefc-abb2-4e5c-b977-83d94ebb6f0b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101943 Aug 09 18:51:02.028876 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 137/278] 10.222.0.57 () {58 vars in 1275 bytes} [Tue Aug 9 18:51:01 2022] GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:51:02.061893 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-11019509-630d-46af-843c-269df9d53c89 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:02.062719 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-11019509-630d-46af-843c-269df9d53c89 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:02.068896 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-11019509-630d-46af-843c-269df9d53c89 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:02.069506 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-11019509-630d-46af-843c-269df9d53c89 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:02.069967 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-11019509-630d-46af-843c-269df9d53c89 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:02.070695 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-11019509-630d-46af-843c-269df9d53c89 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:02.071323 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-11019509-630d-46af-843c-269df9d53c89 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:02.071854 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-11019509-630d-46af-843c-269df9d53c89 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:02.147467 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-6bbed699-87c0-41f6-9959-294e9f866ef1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:02.160973 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-6bbed699-87c0-41f6-9959-294e9f866ef1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:02.168064 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-6bbed699-87c0-41f6-9959-294e9f866ef1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:02.168064 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-6bbed699-87c0-41f6-9959-294e9f866ef1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1722 microversion: 2.20 time: 0.194056 Aug 09 18:51:02.168064 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 142/279] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:01 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:51:02.174377 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-6b8d60e1-f4ec-4d5b-a27c-29c9c3261d0c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:02.174996 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-6b8d60e1-f4ec-4d5b-a27c-29c9c3261d0c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:02.182617 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6b8d60e1-f4ec-4d5b-a27c-29c9c3261d0c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:02.183106 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6b8d60e1-f4ec-4d5b-a27c-29c9c3261d0c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:02.183532 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6b8d60e1-f4ec-4d5b-a27c-29c9c3261d0c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:02.184230 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6b8d60e1-f4ec-4d5b-a27c-29c9c3261d0c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:02.184708 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6b8d60e1-f4ec-4d5b-a27c-29c9c3261d0c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:02.185120 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6b8d60e1-f4ec-4d5b-a27c-29c9c3261d0c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:02.366236 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-6b8d60e1-f4ec-4d5b-a27c-29c9c3261d0c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:02.376323 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-6b8d60e1-f4ec-4d5b-a27c-29c9c3261d0c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1523 microversion: 2.1 time: 0.209298 Aug 09 18:51:02.376907 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 143/280] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:02 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1523 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:02.389588 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-7707eb41-f7f7-4575-adfa-30f04338a865 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1993126895", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-328605986", "security_groups": [{"name": "tempest-secgroup-smoke-943284035"}], "networks": [{"uuid": "99cd3e84-8648-491d-826b-9e1d14c5296a"}], "block_device_mapping_v2": [{"uuid": "308374ba-eff4-4120-a496-cb054ca92b01", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:51:02.426841 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-11019509-630d-46af-843c-269df9d53c89 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:02.435614 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-11019509-630d-46af-843c-269df9d53c89 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1723 microversion: 2.1 time: 0.378835 Aug 09 18:51:02.436425 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 138/281] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:02 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1723 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:51:02.515560 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.network.neutron [None req-7707eb41-f7f7-4575-adfa-30f04338a865 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] validate_networks() for [('99cd3e84-8648-491d-826b-9e1d14c5296a', None, None, None, None, None)] {{(pid=124725) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:51:02.916694 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-7707eb41-f7f7-4575-adfa-30f04338a865 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Flavor limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:51:02.916694 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-7707eb41-f7f7-4575-adfa-30f04338a865 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Image limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:51:02.916694 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-7707eb41-f7f7-4575-adfa-30f04338a865 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Flavor pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:51:02.918245 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-7707eb41-f7f7-4575-adfa-30f04338a865 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Image pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:51:02.918667 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-7707eb41-f7f7-4575-adfa-30f04338a865 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:51:02.929615 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7707eb41-f7f7-4575-adfa-30f04338a865 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:02.930096 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7707eb41-f7f7-4575-adfa-30f04338a865 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:02.930530 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7707eb41-f7f7-4575-adfa-30f04338a865 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:02.931259 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7707eb41-f7f7-4575-adfa-30f04338a865 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:02.931805 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7707eb41-f7f7-4575-adfa-30f04338a865 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:02.932485 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7707eb41-f7f7-4575-adfa-30f04338a865 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:02.966098 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-7707eb41-f7f7-4575-adfa-30f04338a865 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Getting quotas for project 6efde3fd7658438cad16413a10503384. Resources: {'cores', 'ram', 'instances'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:51:02.971115 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-7707eb41-f7f7-4575-adfa-30f04338a865 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Getting quotas for user dc285681bd4843028f0fbbbd01ff4adb and project 6efde3fd7658438cad16413a10503384. Resources: {'cores', 'ram', 'instances'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:51:03.037412 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-7707eb41-f7f7-4575-adfa-30f04338a865 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Going to run 1 instances... {{(pid=124725) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:51:03.039512 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-7707eb41-f7f7-4575-adfa-30f04338a865 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='308374ba-eff4-4120-a496-cb054ca92b01',volume_size=None,volume_type=None)] {{(pid=124725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:51:03.200149 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-ad905150-725c-485c-9cf1-6348360ec618 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:03.201383 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-ad905150-725c-485c-9cf1-6348360ec618 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:03.209279 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ad905150-725c-485c-9cf1-6348360ec618 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:03.209944 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ad905150-725c-485c-9cf1-6348360ec618 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:03.210726 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ad905150-725c-485c-9cf1-6348360ec618 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:03.211659 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ad905150-725c-485c-9cf1-6348360ec618 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:03.212173 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ad905150-725c-485c-9cf1-6348360ec618 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:03.212657 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ad905150-725c-485c-9cf1-6348360ec618 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:03.563792 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-7707eb41-f7f7-4575-adfa-30f04338a865 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.185751 Aug 09 18:51:03.564782 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 144/282] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 9 18:51:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 1187 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:51:03.571542 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-1b546523-06f0-4eba-ab7d-0b9fa3765dfd tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:03.582098 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-1b546523-06f0-4eba-ab7d-0b9fa3765dfd tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:03.588803 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1b546523-06f0-4eba-ab7d-0b9fa3765dfd tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:03.589287 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1b546523-06f0-4eba-ab7d-0b9fa3765dfd tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:03.589941 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1b546523-06f0-4eba-ab7d-0b9fa3765dfd tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:03.590454 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1b546523-06f0-4eba-ab7d-0b9fa3765dfd tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:03.590901 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1b546523-06f0-4eba-ab7d-0b9fa3765dfd tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:03.591575 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1b546523-06f0-4eba-ab7d-0b9fa3765dfd tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:03.624063 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-ad905150-725c-485c-9cf1-6348360ec618 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:03.634198 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-ad905150-725c-485c-9cf1-6348360ec618 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:03.647135 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-ad905150-725c-485c-9cf1-6348360ec618 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:03.648404 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-ad905150-725c-485c-9cf1-6348360ec618 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1722 microversion: 2.20 time: 0.452566 Aug 09 18:51:03.648994 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 139/283] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:03 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1722 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:51:03.655598 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-53efcc6b-f10f-4f44-bd6b-e6cfd5df03a2 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:03.656375 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-53efcc6b-f10f-4f44-bd6b-e6cfd5df03a2 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:03.663189 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-53efcc6b-f10f-4f44-bd6b-e6cfd5df03a2 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:03.663871 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-53efcc6b-f10f-4f44-bd6b-e6cfd5df03a2 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:03.664543 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-53efcc6b-f10f-4f44-bd6b-e6cfd5df03a2 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:03.665894 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-53efcc6b-f10f-4f44-bd6b-e6cfd5df03a2 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:03.673679 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-53efcc6b-f10f-4f44-bd6b-e6cfd5df03a2 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:03.674881 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-53efcc6b-f10f-4f44-bd6b-e6cfd5df03a2 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:03.796066 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1b546523-06f0-4eba-ab7d-0b9fa3765dfd tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:03.805152 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-1b546523-06f0-4eba-ab7d-0b9fa3765dfd tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1523 microversion: 2.1 time: 0.239453 Aug 09 18:51:03.819512 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 145/284] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:03 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1523 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:03.819512 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-8107ef9c-351a-44db-953d-0d9c982118c0 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:03.819512 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-8107ef9c-351a-44db-953d-0d9c982118c0 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:03.840092 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-53efcc6b-f10f-4f44-bd6b-e6cfd5df03a2 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:03.852799 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-53efcc6b-f10f-4f44-bd6b-e6cfd5df03a2 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1723 microversion: 2.1 time: 0.201339 Aug 09 18:51:03.858510 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 140/285] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:03 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:03.865836 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-3595633d-7bd5-443d-98e2-318b3d95c75b req-1fcc2da2-2d35-4a3d-83bc-42289c712cb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "743aafc6-1787-4c6e-be09-3b460a00d5e9", "tag": "2a32c700-6fce-4e74-b894-56a5eba16aed"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:51:03.878033 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-3595633d-7bd5-443d-98e2-318b3d95c75b req-1fcc2da2-2d35-4a3d-83bc-42289c712cb8 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:03.879027 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-3595633d-7bd5-443d-98e2-318b3d95c75b req-1fcc2da2-2d35-4a3d-83bc-42289c712cb8 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:03.879662 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-3595633d-7bd5-443d-98e2-318b3d95c75b req-1fcc2da2-2d35-4a3d-83bc-42289c712cb8 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:03.881659 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-8107ef9c-351a-44db-953d-0d9c982118c0 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:03.888997 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-8107ef9c-351a-44db-953d-0d9c982118c0 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1088 microversion: 2.1 time: 0.081900 Aug 09 18:51:03.889642 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 146/286] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:03 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1088 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:03.892696 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-3595633d-7bd5-443d-98e2-318b3d95c75b req-1fcc2da2-2d35-4a3d-83bc-42289c712cb8 service nova] Creating event network-changed:2a32c700-6fce-4e74-b894-56a5eba16aed for instance 743aafc6-1787-4c6e-be09-3b460a00d5e9 on hv-cinder-82660 Aug 09 18:51:03.898665 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-3595633d-7bd5-443d-98e2-318b3d95c75b req-1fcc2da2-2d35-4a3d-83bc-42289c712cb8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038547 Aug 09 18:51:03.903005 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 141/287] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:51:04.672401 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-fa16a8dc-b34d-4ec4-b5b0-df49d8e1a362 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:04.673024 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-fa16a8dc-b34d-4ec4-b5b0-df49d8e1a362 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:04.679545 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fa16a8dc-b34d-4ec4-b5b0-df49d8e1a362 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:04.680017 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fa16a8dc-b34d-4ec4-b5b0-df49d8e1a362 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:04.680444 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fa16a8dc-b34d-4ec4-b5b0-df49d8e1a362 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:04.681162 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fa16a8dc-b34d-4ec4-b5b0-df49d8e1a362 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:04.681636 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fa16a8dc-b34d-4ec4-b5b0-df49d8e1a362 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:04.682176 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fa16a8dc-b34d-4ec4-b5b0-df49d8e1a362 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:04.828628 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-2cb27501-f243-4e8d-93ee-6c340ccbbe10 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:04.829444 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-2cb27501-f243-4e8d-93ee-6c340ccbbe10 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:04.833237 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-fa16a8dc-b34d-4ec4-b5b0-df49d8e1a362 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:04.836759 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2cb27501-f243-4e8d-93ee-6c340ccbbe10 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:04.837511 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2cb27501-f243-4e8d-93ee-6c340ccbbe10 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:04.838038 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2cb27501-f243-4e8d-93ee-6c340ccbbe10 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:04.838813 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2cb27501-f243-4e8d-93ee-6c340ccbbe10 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:04.839333 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2cb27501-f243-4e8d-93ee-6c340ccbbe10 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:04.839971 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2cb27501-f243-4e8d-93ee-6c340ccbbe10 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:04.843043 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-fa16a8dc-b34d-4ec4-b5b0-df49d8e1a362 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:04.844591 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-fa16a8dc-b34d-4ec4-b5b0-df49d8e1a362 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:04.845886 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-fa16a8dc-b34d-4ec4-b5b0-df49d8e1a362 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1722 microversion: 2.20 time: 0.178085 Aug 09 18:51:04.855847 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 147/288] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:04 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:51:04.880224 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-acc9804b-9ccd-40be-b6d3-19dd42a99cbb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:04.880841 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-acc9804b-9ccd-40be-b6d3-19dd42a99cbb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:04.887366 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-acc9804b-9ccd-40be-b6d3-19dd42a99cbb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:04.888148 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-acc9804b-9ccd-40be-b6d3-19dd42a99cbb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:04.888586 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-acc9804b-9ccd-40be-b6d3-19dd42a99cbb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:04.889309 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-acc9804b-9ccd-40be-b6d3-19dd42a99cbb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:04.889963 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-acc9804b-9ccd-40be-b6d3-19dd42a99cbb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:04.890397 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-acc9804b-9ccd-40be-b6d3-19dd42a99cbb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:05.019888 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-2cb27501-f243-4e8d-93ee-6c340ccbbe10 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:05.027570 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-2cb27501-f243-4e8d-93ee-6c340ccbbe10 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1523 microversion: 2.1 time: 0.204315 Aug 09 18:51:05.028159 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 142/289] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:04 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1523 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:51:05.033543 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-0bd83239-3b7b-4663-8664-fd05d3a51443 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:05.034160 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-0bd83239-3b7b-4663-8664-fd05d3a51443 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:05.040009 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0bd83239-3b7b-4663-8664-fd05d3a51443 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:05.040492 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0bd83239-3b7b-4663-8664-fd05d3a51443 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:05.040954 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0bd83239-3b7b-4663-8664-fd05d3a51443 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:05.041856 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0bd83239-3b7b-4663-8664-fd05d3a51443 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:05.042557 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0bd83239-3b7b-4663-8664-fd05d3a51443 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:05.043231 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0bd83239-3b7b-4663-8664-fd05d3a51443 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:05.075508 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-acc9804b-9ccd-40be-b6d3-19dd42a99cbb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:05.102473 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-acc9804b-9ccd-40be-b6d3-19dd42a99cbb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1723 microversion: 2.1 time: 0.226410 Aug 09 18:51:05.103178 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 148/290] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:04 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:05.121082 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-0bd83239-3b7b-4663-8664-fd05d3a51443 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:05.139288 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-0bd83239-3b7b-4663-8664-fd05d3a51443 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1138 microversion: 2.1 time: 0.109863 Aug 09 18:51:05.139951 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 143/291] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:05 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1138 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:05.870442 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b01bf857-5155-47bd-8bf9-a6478e914917 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:05.871062 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-b01bf857-5155-47bd-8bf9-a6478e914917 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:05.878475 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b01bf857-5155-47bd-8bf9-a6478e914917 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:05.878950 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b01bf857-5155-47bd-8bf9-a6478e914917 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:05.879373 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b01bf857-5155-47bd-8bf9-a6478e914917 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:05.880190 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b01bf857-5155-47bd-8bf9-a6478e914917 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:05.880816 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b01bf857-5155-47bd-8bf9-a6478e914917 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:05.881230 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b01bf857-5155-47bd-8bf9-a6478e914917 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:06.021646 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-b01bf857-5155-47bd-8bf9-a6478e914917 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:06.030632 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-b01bf857-5155-47bd-8bf9-a6478e914917 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:06.032137 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-b01bf857-5155-47bd-8bf9-a6478e914917 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:06.033299 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-b01bf857-5155-47bd-8bf9-a6478e914917 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1722 microversion: 2.20 time: 0.167084 Aug 09 18:51:06.033913 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 149/292] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:05 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:51:06.048206 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-9cbe763f-1541-4a50-a578-ebb67e77daf3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:06.049286 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-9cbe763f-1541-4a50-a578-ebb67e77daf3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:06.055834 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9cbe763f-1541-4a50-a578-ebb67e77daf3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:06.056550 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9cbe763f-1541-4a50-a578-ebb67e77daf3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:06.056986 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9cbe763f-1541-4a50-a578-ebb67e77daf3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:06.057718 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9cbe763f-1541-4a50-a578-ebb67e77daf3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:06.058255 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9cbe763f-1541-4a50-a578-ebb67e77daf3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:06.058731 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9cbe763f-1541-4a50-a578-ebb67e77daf3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:06.127988 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-036edfb9-0835-4916-90ac-d3e7e4a755a4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:06.129010 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-036edfb9-0835-4916-90ac-d3e7e4a755a4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:06.136278 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-036edfb9-0835-4916-90ac-d3e7e4a755a4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:06.136827 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-036edfb9-0835-4916-90ac-d3e7e4a755a4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:06.137230 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-036edfb9-0835-4916-90ac-d3e7e4a755a4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:06.137966 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-036edfb9-0835-4916-90ac-d3e7e4a755a4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:06.138416 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-036edfb9-0835-4916-90ac-d3e7e4a755a4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:06.140251 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-036edfb9-0835-4916-90ac-d3e7e4a755a4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:06.215460 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-9cbe763f-1541-4a50-a578-ebb67e77daf3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:06.224809 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-9cbe763f-1541-4a50-a578-ebb67e77daf3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1523 microversion: 2.1 time: 0.180419 Aug 09 18:51:06.225401 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 144/293] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:06 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:06.229937 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-f399fc52-e62f-40e0-8337-9776caa6094f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:06.230765 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-f399fc52-e62f-40e0-8337-9776caa6094f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:06.238182 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f399fc52-e62f-40e0-8337-9776caa6094f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:06.238669 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f399fc52-e62f-40e0-8337-9776caa6094f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:06.239289 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f399fc52-e62f-40e0-8337-9776caa6094f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:06.239979 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f399fc52-e62f-40e0-8337-9776caa6094f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:06.240865 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f399fc52-e62f-40e0-8337-9776caa6094f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:06.241283 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f399fc52-e62f-40e0-8337-9776caa6094f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:06.282457 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-036edfb9-0835-4916-90ac-d3e7e4a755a4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:06.290950 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-036edfb9-0835-4916-90ac-d3e7e4a755a4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1723 microversion: 2.1 time: 0.167827 Aug 09 18:51:06.291525 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 150/294] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:06 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:51:06.328163 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-f399fc52-e62f-40e0-8337-9776caa6094f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:06.335883 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-f399fc52-e62f-40e0-8337-9776caa6094f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1186 microversion: 2.1 time: 0.109446 Aug 09 18:51:06.336474 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 145/295] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:06 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1186 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:07.056346 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-96ab14d2-da34-4d68-a50e-948027bba89f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:07.056985 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-96ab14d2-da34-4d68-a50e-948027bba89f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:07.063809 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-96ab14d2-da34-4d68-a50e-948027bba89f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:07.064269 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-96ab14d2-da34-4d68-a50e-948027bba89f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:07.064710 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-96ab14d2-da34-4d68-a50e-948027bba89f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:07.065392 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-96ab14d2-da34-4d68-a50e-948027bba89f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:07.065943 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-96ab14d2-da34-4d68-a50e-948027bba89f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:07.070555 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-96ab14d2-da34-4d68-a50e-948027bba89f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:07.211816 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-96ab14d2-da34-4d68-a50e-948027bba89f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:07.227867 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-96ab14d2-da34-4d68-a50e-948027bba89f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:07.229427 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-96ab14d2-da34-4d68-a50e-948027bba89f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:07.230637 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-96ab14d2-da34-4d68-a50e-948027bba89f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1722 microversion: 2.20 time: 0.178312 Aug 09 18:51:07.231200 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 151/296] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:07 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:51:07.247046 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-b9d98a87-75db-4844-b9d3-e72b53fca971 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:07.247744 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-b9d98a87-75db-4844-b9d3-e72b53fca971 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:07.255190 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b9d98a87-75db-4844-b9d3-e72b53fca971 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:07.255681 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b9d98a87-75db-4844-b9d3-e72b53fca971 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:07.256114 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b9d98a87-75db-4844-b9d3-e72b53fca971 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:07.256835 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b9d98a87-75db-4844-b9d3-e72b53fca971 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:07.257484 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b9d98a87-75db-4844-b9d3-e72b53fca971 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:07.258076 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b9d98a87-75db-4844-b9d3-e72b53fca971 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:07.315784 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-37b90965-2c83-4d1a-82a9-709b35a7c3f4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:07.316802 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-37b90965-2c83-4d1a-82a9-709b35a7c3f4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:07.325278 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-37b90965-2c83-4d1a-82a9-709b35a7c3f4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:07.326089 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-37b90965-2c83-4d1a-82a9-709b35a7c3f4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:07.326835 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-37b90965-2c83-4d1a-82a9-709b35a7c3f4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:07.327729 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-37b90965-2c83-4d1a-82a9-709b35a7c3f4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:07.328191 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-37b90965-2c83-4d1a-82a9-709b35a7c3f4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:07.328621 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-37b90965-2c83-4d1a-82a9-709b35a7c3f4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:07.340364 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=100 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:51:07.493343 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-37b90965-2c83-4d1a-82a9-709b35a7c3f4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:07.505795 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-37b90965-2c83-4d1a-82a9-709b35a7c3f4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1723 microversion: 2.1 time: 0.195045 Aug 09 18:51:07.516333 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 152/297] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:07 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:51:07.523228 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-b9d98a87-75db-4844-b9d3-e72b53fca971 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:07.525987 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-2df2bf27-bd73-47e6-9810-8e08e8835073 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:07.542120 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-2df2bf27-bd73-47e6-9810-8e08e8835073 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:07.542582 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-b9d98a87-75db-4844-b9d3-e72b53fca971 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1523 microversion: 2.1 time: 0.288451 Aug 09 18:51:07.542582 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 146/298] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:07 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1523 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:07.543982 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2df2bf27-bd73-47e6-9810-8e08e8835073 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:07.544587 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2df2bf27-bd73-47e6-9810-8e08e8835073 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:07.545412 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2df2bf27-bd73-47e6-9810-8e08e8835073 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:07.546608 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2df2bf27-bd73-47e6-9810-8e08e8835073 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:07.548655 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2df2bf27-bd73-47e6-9810-8e08e8835073 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:07.551129 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2df2bf27-bd73-47e6-9810-8e08e8835073 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:07.830607 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-2df2bf27-bd73-47e6-9810-8e08e8835073 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:07.838193 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-2df2bf27-bd73-47e6-9810-8e08e8835073 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1271 microversion: 2.1 time: 0.318812 Aug 09 18:51:07.838760 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 153/299] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:07 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1271 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:08.221971 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-672d2854-916a-4f6f-831d-dea8672193a3 req-21b28d94-4505-4a58-9d14-0896c820cc20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7", "tag": "f4782f09-a0b0-4715-98fa-ea0d74933d8d"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:51:08.231944 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-672d2854-916a-4f6f-831d-dea8672193a3 req-21b28d94-4505-4a58-9d14-0896c820cc20 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:08.232420 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-672d2854-916a-4f6f-831d-dea8672193a3 req-21b28d94-4505-4a58-9d14-0896c820cc20 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:08.233442 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-672d2854-916a-4f6f-831d-dea8672193a3 req-21b28d94-4505-4a58-9d14-0896c820cc20 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:08.248434 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-672d2854-916a-4f6f-831d-dea8672193a3 req-21b28d94-4505-4a58-9d14-0896c820cc20 service nova] Creating event network-changed:f4782f09-a0b0-4715-98fa-ea0d74933d8d for instance fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 on hv-cinder-82660 Aug 09 18:51:08.253934 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-672d2854-916a-4f6f-831d-dea8672193a3 req-21b28d94-4505-4a58-9d14-0896c820cc20 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035602 Aug 09 18:51:08.254565 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 147/300] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:51:08.257169 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-ef5bc4a5-c3d3-4768-9653-bdd4cdd6ad32 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:08.257819 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-ef5bc4a5-c3d3-4768-9653-bdd4cdd6ad32 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:08.267660 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ef5bc4a5-c3d3-4768-9653-bdd4cdd6ad32 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:08.268137 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ef5bc4a5-c3d3-4768-9653-bdd4cdd6ad32 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:08.268569 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ef5bc4a5-c3d3-4768-9653-bdd4cdd6ad32 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:08.269297 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ef5bc4a5-c3d3-4768-9653-bdd4cdd6ad32 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:08.269787 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ef5bc4a5-c3d3-4768-9653-bdd4cdd6ad32 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:08.270202 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ef5bc4a5-c3d3-4768-9653-bdd4cdd6ad32 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:08.415174 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-ef5bc4a5-c3d3-4768-9653-bdd4cdd6ad32 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:08.423637 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-ef5bc4a5-c3d3-4768-9653-bdd4cdd6ad32 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:08.426003 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-ef5bc4a5-c3d3-4768-9653-bdd4cdd6ad32 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:08.427446 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-ef5bc4a5-c3d3-4768-9653-bdd4cdd6ad32 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1722 microversion: 2.20 time: 0.174673 Aug 09 18:51:08.428187 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 154/301] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:08 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:51:08.531095 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-92530236-3927-4658-b12a-cd13b1c24866 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:08.531983 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-92530236-3927-4658-b12a-cd13b1c24866 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:08.539629 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-92530236-3927-4658-b12a-cd13b1c24866 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:08.540119 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-92530236-3927-4658-b12a-cd13b1c24866 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:08.540543 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-92530236-3927-4658-b12a-cd13b1c24866 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:08.541241 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-92530236-3927-4658-b12a-cd13b1c24866 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:08.541719 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-92530236-3927-4658-b12a-cd13b1c24866 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:08.542135 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-92530236-3927-4658-b12a-cd13b1c24866 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:08.558935 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-9b118c71-0643-4c4e-a255-cf5b46ad816f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:08.559642 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-9b118c71-0643-4c4e-a255-cf5b46ad816f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:08.570341 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9b118c71-0643-4c4e-a255-cf5b46ad816f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:08.579203 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9b118c71-0643-4c4e-a255-cf5b46ad816f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:08.579740 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9b118c71-0643-4c4e-a255-cf5b46ad816f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:08.580488 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9b118c71-0643-4c4e-a255-cf5b46ad816f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:08.580956 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9b118c71-0643-4c4e-a255-cf5b46ad816f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:08.581384 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9b118c71-0643-4c4e-a255-cf5b46ad816f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:08.750414 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-9b118c71-0643-4c4e-a255-cf5b46ad816f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:08.761140 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-9b118c71-0643-4c4e-a255-cf5b46ad816f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1523 microversion: 2.1 time: 0.206336 Aug 09 18:51:08.762205 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 155/302] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:08 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1523 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:08.799460 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-92530236-3927-4658-b12a-cd13b1c24866 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:08.807929 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-92530236-3927-4658-b12a-cd13b1c24866 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1723 microversion: 2.1 time: 0.282591 Aug 09 18:51:08.808517 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 148/303] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:08 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:08.862310 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c7597c54-c93c-46f8-bff6-bcac3172064f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:08.862954 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-c7597c54-c93c-46f8-bff6-bcac3172064f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:08.869134 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c7597c54-c93c-46f8-bff6-bcac3172064f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:08.882775 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c7597c54-c93c-46f8-bff6-bcac3172064f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:08.882775 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c7597c54-c93c-46f8-bff6-bcac3172064f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:08.882775 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c7597c54-c93c-46f8-bff6-bcac3172064f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:08.882775 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c7597c54-c93c-46f8-bff6-bcac3172064f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:08.883143 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c7597c54-c93c-46f8-bff6-bcac3172064f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:09.052111 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-c7597c54-c93c-46f8-bff6-bcac3172064f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:09.061325 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-c7597c54-c93c-46f8-bff6-bcac3172064f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1259 microversion: 2.1 time: 0.202903 Aug 09 18:51:09.065784 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 156/304] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:08 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1259 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:09.449938 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-379d5f92-008c-46f5-b645-660e446ae78b tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:09.450544 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-379d5f92-008c-46f5-b645-660e446ae78b tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:09.457085 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-379d5f92-008c-46f5-b645-660e446ae78b tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:09.457597 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-379d5f92-008c-46f5-b645-660e446ae78b tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:09.458125 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-379d5f92-008c-46f5-b645-660e446ae78b tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:09.458792 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-379d5f92-008c-46f5-b645-660e446ae78b tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:09.459239 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-379d5f92-008c-46f5-b645-660e446ae78b tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:09.459660 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-379d5f92-008c-46f5-b645-660e446ae78b tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:09.474843 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell1:SELECT=100 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:51:09.602938 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-379d5f92-008c-46f5-b645-660e446ae78b tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:09.615845 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-379d5f92-008c-46f5-b645-660e446ae78b tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:09.617706 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-379d5f92-008c-46f5-b645-660e446ae78b tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:09.618907 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-379d5f92-008c-46f5-b645-660e446ae78b tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1722 microversion: 2.20 time: 0.173080 Aug 09 18:51:09.619482 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 149/305] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:09 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:51:09.784052 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-919ff36e-600a-4392-9875-fe4b5a04cd6a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:09.784577 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-919ff36e-600a-4392-9875-fe4b5a04cd6a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:09.791142 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-919ff36e-600a-4392-9875-fe4b5a04cd6a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:09.791626 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-919ff36e-600a-4392-9875-fe4b5a04cd6a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:09.792058 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-919ff36e-600a-4392-9875-fe4b5a04cd6a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:09.792743 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-919ff36e-600a-4392-9875-fe4b5a04cd6a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:09.793197 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-919ff36e-600a-4392-9875-fe4b5a04cd6a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:09.793657 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-919ff36e-600a-4392-9875-fe4b5a04cd6a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:09.830980 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-611bcaa1-17f1-4a45-8e7b-acbb058382c4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:09.831594 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-611bcaa1-17f1-4a45-8e7b-acbb058382c4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:09.838057 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-611bcaa1-17f1-4a45-8e7b-acbb058382c4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:09.838549 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-611bcaa1-17f1-4a45-8e7b-acbb058382c4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:09.838988 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-611bcaa1-17f1-4a45-8e7b-acbb058382c4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:09.839754 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-611bcaa1-17f1-4a45-8e7b-acbb058382c4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:09.840399 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-611bcaa1-17f1-4a45-8e7b-acbb058382c4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:09.840830 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-611bcaa1-17f1-4a45-8e7b-acbb058382c4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:09.931986 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-919ff36e-600a-4392-9875-fe4b5a04cd6a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:09.940056 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-919ff36e-600a-4392-9875-fe4b5a04cd6a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1523 microversion: 2.1 time: 0.160349 Aug 09 18:51:09.940598 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 157/306] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:09 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:09.984855 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-611bcaa1-17f1-4a45-8e7b-acbb058382c4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:09.992971 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-611bcaa1-17f1-4a45-8e7b-acbb058382c4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1723 microversion: 2.1 time: 0.166788 Aug 09 18:51:09.993559 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 150/307] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:09 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:10.083282 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-60facefb-8d20-4a95-be3c-5ce115228566 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:10.083894 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-60facefb-8d20-4a95-be3c-5ce115228566 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:10.089993 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-60facefb-8d20-4a95-be3c-5ce115228566 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:10.090478 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-60facefb-8d20-4a95-be3c-5ce115228566 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:10.090913 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-60facefb-8d20-4a95-be3c-5ce115228566 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:10.091606 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-60facefb-8d20-4a95-be3c-5ce115228566 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:10.092614 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-60facefb-8d20-4a95-be3c-5ce115228566 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:10.093055 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-60facefb-8d20-4a95-be3c-5ce115228566 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:10.221269 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-60facefb-8d20-4a95-be3c-5ce115228566 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:10.229207 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-60facefb-8d20-4a95-be3c-5ce115228566 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1259 microversion: 2.1 time: 0.149787 Aug 09 18:51:10.229912 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 158/308] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:10 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:10.641644 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-af8aae2c-1932-49ab-87aa-7e0432fe96f7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:10.642246 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-af8aae2c-1932-49ab-87aa-7e0432fe96f7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:10.648932 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-af8aae2c-1932-49ab-87aa-7e0432fe96f7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:10.649418 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-af8aae2c-1932-49ab-87aa-7e0432fe96f7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:10.649910 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-af8aae2c-1932-49ab-87aa-7e0432fe96f7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:10.650657 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-af8aae2c-1932-49ab-87aa-7e0432fe96f7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:10.651141 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-af8aae2c-1932-49ab-87aa-7e0432fe96f7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:10.651595 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-af8aae2c-1932-49ab-87aa-7e0432fe96f7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:10.799728 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-af8aae2c-1932-49ab-87aa-7e0432fe96f7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:10.799728 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-af8aae2c-1932-49ab-87aa-7e0432fe96f7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:10.800023 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-af8aae2c-1932-49ab-87aa-7e0432fe96f7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:10.800023 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-af8aae2c-1932-49ab-87aa-7e0432fe96f7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1722 microversion: 2.20 time: 0.154467 Aug 09 18:51:10.800023 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 151/309] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:10 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:51:10.962252 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f9884f0c-0fed-4aa8-8b41-589c8229a8dc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:10.962865 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-f9884f0c-0fed-4aa8-8b41-589c8229a8dc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:10.970938 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f9884f0c-0fed-4aa8-8b41-589c8229a8dc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:10.971427 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f9884f0c-0fed-4aa8-8b41-589c8229a8dc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:10.971860 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f9884f0c-0fed-4aa8-8b41-589c8229a8dc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:10.972558 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f9884f0c-0fed-4aa8-8b41-589c8229a8dc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:10.973014 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f9884f0c-0fed-4aa8-8b41-589c8229a8dc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:10.973438 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f9884f0c-0fed-4aa8-8b41-589c8229a8dc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:11.014163 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-5b515f37-f6de-44c3-9596-2c169dda1bdb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:11.014810 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-5b515f37-f6de-44c3-9596-2c169dda1bdb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:11.020915 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5b515f37-f6de-44c3-9596-2c169dda1bdb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:11.021405 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5b515f37-f6de-44c3-9596-2c169dda1bdb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:11.021885 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5b515f37-f6de-44c3-9596-2c169dda1bdb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:11.022578 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5b515f37-f6de-44c3-9596-2c169dda1bdb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:11.023030 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5b515f37-f6de-44c3-9596-2c169dda1bdb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:11.023495 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5b515f37-f6de-44c3-9596-2c169dda1bdb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:11.109414 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f9884f0c-0fed-4aa8-8b41-589c8229a8dc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:11.117243 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f9884f0c-0fed-4aa8-8b41-589c8229a8dc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1523 microversion: 2.1 time: 0.160016 Aug 09 18:51:11.118768 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 159/310] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:10 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:11.156943 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-5b515f37-f6de-44c3-9596-2c169dda1bdb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:11.164952 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-5b515f37-f6de-44c3-9596-2c169dda1bdb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1723 microversion: 2.1 time: 0.154596 Aug 09 18:51:11.165465 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 152/311] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:11 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:51:11.249913 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-cdafe090-1f29-43a0-8554-d8105359ed1d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:11.250517 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-cdafe090-1f29-43a0-8554-d8105359ed1d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:11.256477 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cdafe090-1f29-43a0-8554-d8105359ed1d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:11.256953 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cdafe090-1f29-43a0-8554-d8105359ed1d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:11.257425 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cdafe090-1f29-43a0-8554-d8105359ed1d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:11.258117 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cdafe090-1f29-43a0-8554-d8105359ed1d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:11.258563 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cdafe090-1f29-43a0-8554-d8105359ed1d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:11.258981 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cdafe090-1f29-43a0-8554-d8105359ed1d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:11.390320 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-cdafe090-1f29-43a0-8554-d8105359ed1d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:11.397955 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-cdafe090-1f29-43a0-8554-d8105359ed1d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1259 microversion: 2.1 time: 0.151808 Aug 09 18:51:11.398536 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 160/312] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:11 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:11.816573 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-6675f1c2-738e-4575-bab4-71a26054edf1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:11.817183 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-6675f1c2-738e-4575-bab4-71a26054edf1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:11.823676 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6675f1c2-738e-4575-bab4-71a26054edf1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:11.824162 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6675f1c2-738e-4575-bab4-71a26054edf1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:11.830691 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6675f1c2-738e-4575-bab4-71a26054edf1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:11.830691 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6675f1c2-738e-4575-bab4-71a26054edf1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:11.830691 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6675f1c2-738e-4575-bab4-71a26054edf1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:11.830691 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6675f1c2-738e-4575-bab4-71a26054edf1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:11.957042 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-6675f1c2-738e-4575-bab4-71a26054edf1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:11.964908 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-6675f1c2-738e-4575-bab4-71a26054edf1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:11.966435 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-6675f1c2-738e-4575-bab4-71a26054edf1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:11.967571 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-6675f1c2-738e-4575-bab4-71a26054edf1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1743 microversion: 2.20 time: 0.154987 Aug 09 18:51:11.968154 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 153/313] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:11 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:51:12.138933 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e4566f6f-61ae-47ae-9ac0-64b3630edc89 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:12.139483 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e4566f6f-61ae-47ae-9ac0-64b3630edc89 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:12.145966 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e4566f6f-61ae-47ae-9ac0-64b3630edc89 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:12.146244 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e4566f6f-61ae-47ae-9ac0-64b3630edc89 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:12.146667 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e4566f6f-61ae-47ae-9ac0-64b3630edc89 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:12.147343 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e4566f6f-61ae-47ae-9ac0-64b3630edc89 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:12.147789 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e4566f6f-61ae-47ae-9ac0-64b3630edc89 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:12.148206 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e4566f6f-61ae-47ae-9ac0-64b3630edc89 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:12.186111 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-3ddc5298-50be-499c-ba98-292c113a7db5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:12.186740 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-3ddc5298-50be-499c-ba98-292c113a7db5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:12.193445 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3ddc5298-50be-499c-ba98-292c113a7db5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:12.193966 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3ddc5298-50be-499c-ba98-292c113a7db5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:12.194399 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3ddc5298-50be-499c-ba98-292c113a7db5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:12.195094 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3ddc5298-50be-499c-ba98-292c113a7db5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:12.195742 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3ddc5298-50be-499c-ba98-292c113a7db5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:12.196169 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3ddc5298-50be-499c-ba98-292c113a7db5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:12.288454 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e4566f6f-61ae-47ae-9ac0-64b3630edc89 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:12.296036 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e4566f6f-61ae-47ae-9ac0-64b3630edc89 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1523 microversion: 2.1 time: 0.161091 Aug 09 18:51:12.297124 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 161/314] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:12 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:12.341022 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-3ddc5298-50be-499c-ba98-292c113a7db5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:12.349744 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-3ddc5298-50be-499c-ba98-292c113a7db5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1723 microversion: 2.1 time: 0.166953 Aug 09 18:51:12.350293 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 154/315] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:12 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:51:12.419660 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c67f727b-aa81-4dc1-bd7e-db98ec789a01 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:12.420186 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-c67f727b-aa81-4dc1-bd7e-db98ec789a01 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:12.426520 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c67f727b-aa81-4dc1-bd7e-db98ec789a01 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:12.427007 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c67f727b-aa81-4dc1-bd7e-db98ec789a01 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:12.427438 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c67f727b-aa81-4dc1-bd7e-db98ec789a01 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:12.428162 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c67f727b-aa81-4dc1-bd7e-db98ec789a01 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:12.428621 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c67f727b-aa81-4dc1-bd7e-db98ec789a01 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:12.436984 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c67f727b-aa81-4dc1-bd7e-db98ec789a01 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:12.560225 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-c67f727b-aa81-4dc1-bd7e-db98ec789a01 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:12.568364 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-c67f727b-aa81-4dc1-bd7e-db98ec789a01 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1259 microversion: 2.1 time: 0.152850 Aug 09 18:51:12.568922 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 162/316] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:12 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:12.990595 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-3da043b7-4365-4ffd-9253-d7f5f1219676 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:12.991197 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-3da043b7-4365-4ffd-9253-d7f5f1219676 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:12.997657 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3da043b7-4365-4ffd-9253-d7f5f1219676 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:12.998187 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3da043b7-4365-4ffd-9253-d7f5f1219676 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:12.998621 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3da043b7-4365-4ffd-9253-d7f5f1219676 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:12.999311 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3da043b7-4365-4ffd-9253-d7f5f1219676 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:12.999755 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3da043b7-4365-4ffd-9253-d7f5f1219676 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:13.000170 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3da043b7-4365-4ffd-9253-d7f5f1219676 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:13.130382 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-3da043b7-4365-4ffd-9253-d7f5f1219676 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:13.138637 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-3da043b7-4365-4ffd-9253-d7f5f1219676 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:13.141017 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-3da043b7-4365-4ffd-9253-d7f5f1219676 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:13.141963 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-3da043b7-4365-4ffd-9253-d7f5f1219676 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1743 microversion: 2.20 time: 0.155353 Aug 09 18:51:13.142525 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 155/317] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:12 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:51:13.318235 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-8d27aee3-df73-4f40-aaf1-cddb798e404a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:13.318881 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-8d27aee3-df73-4f40-aaf1-cddb798e404a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:13.320808 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=2 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:51:13.321963 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:51:13.326559 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8d27aee3-df73-4f40-aaf1-cddb798e404a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:13.327045 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8d27aee3-df73-4f40-aaf1-cddb798e404a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:13.327481 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8d27aee3-df73-4f40-aaf1-cddb798e404a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:13.329207 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8d27aee3-df73-4f40-aaf1-cddb798e404a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:13.329917 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8d27aee3-df73-4f40-aaf1-cddb798e404a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:13.330553 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8d27aee3-df73-4f40-aaf1-cddb798e404a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:13.371366 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-cdad833b-244e-42c5-afcf-2b3f357dcbb5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:13.371862 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-cdad833b-244e-42c5-afcf-2b3f357dcbb5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:13.378676 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cdad833b-244e-42c5-afcf-2b3f357dcbb5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:13.379166 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cdad833b-244e-42c5-afcf-2b3f357dcbb5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:13.379602 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cdad833b-244e-42c5-afcf-2b3f357dcbb5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:13.380388 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cdad833b-244e-42c5-afcf-2b3f357dcbb5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:13.380810 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cdad833b-244e-42c5-afcf-2b3f357dcbb5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:13.381236 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cdad833b-244e-42c5-afcf-2b3f357dcbb5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:13.468965 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-8d27aee3-df73-4f40-aaf1-cddb798e404a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:13.478103 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-8d27aee3-df73-4f40-aaf1-cddb798e404a tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1523 microversion: 2.1 time: 0.163743 Aug 09 18:51:13.479108 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 163/318] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:13 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:13.519532 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-cdad833b-244e-42c5-afcf-2b3f357dcbb5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:13.528115 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-cdad833b-244e-42c5-afcf-2b3f357dcbb5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1723 microversion: 2.1 time: 0.160551 Aug 09 18:51:13.528623 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 156/319] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:13 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:13.603333 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-dbeb72ac-a021-4b23-8085-c19670867543 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:13.604169 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-dbeb72ac-a021-4b23-8085-c19670867543 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:13.611410 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dbeb72ac-a021-4b23-8085-c19670867543 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:13.611888 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dbeb72ac-a021-4b23-8085-c19670867543 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:13.612307 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dbeb72ac-a021-4b23-8085-c19670867543 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:13.612999 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dbeb72ac-a021-4b23-8085-c19670867543 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:13.613442 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dbeb72ac-a021-4b23-8085-c19670867543 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:13.613884 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dbeb72ac-a021-4b23-8085-c19670867543 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:13.888043 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=8 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:51:13.967162 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-dbeb72ac-a021-4b23-8085-c19670867543 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:13.979590 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-dbeb72ac-a021-4b23-8085-c19670867543 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1259 microversion: 2.1 time: 0.380112 Aug 09 18:51:13.980189 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 164/320] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:13 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1259 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:14.165063 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-4c19dbcb-3dae-4c02-b768-1d5e9c5ed675 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:14.165729 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-4c19dbcb-3dae-4c02-b768-1d5e9c5ed675 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:14.172672 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4c19dbcb-3dae-4c02-b768-1d5e9c5ed675 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:14.173149 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4c19dbcb-3dae-4c02-b768-1d5e9c5ed675 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:14.173619 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4c19dbcb-3dae-4c02-b768-1d5e9c5ed675 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:14.174556 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4c19dbcb-3dae-4c02-b768-1d5e9c5ed675 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:14.175000 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4c19dbcb-3dae-4c02-b768-1d5e9c5ed675 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:14.175419 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4c19dbcb-3dae-4c02-b768-1d5e9c5ed675 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:14.323487 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-4c19dbcb-3dae-4c02-b768-1d5e9c5ed675 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:14.332716 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-4c19dbcb-3dae-4c02-b768-1d5e9c5ed675 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:14.334640 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-4c19dbcb-3dae-4c02-b768-1d5e9c5ed675 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:14.335845 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-4c19dbcb-3dae-4c02-b768-1d5e9c5ed675 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1743 microversion: 2.20 time: 0.174749 Aug 09 18:51:14.336410 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 157/321] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:14 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1743 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:51:14.499596 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5640d8d9-760d-4d99-8c27-a9ea17cf1c88 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:14.500756 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-5640d8d9-760d-4d99-8c27-a9ea17cf1c88 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:14.507308 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5640d8d9-760d-4d99-8c27-a9ea17cf1c88 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:14.507864 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5640d8d9-760d-4d99-8c27-a9ea17cf1c88 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:14.508296 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5640d8d9-760d-4d99-8c27-a9ea17cf1c88 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:14.508990 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5640d8d9-760d-4d99-8c27-a9ea17cf1c88 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:14.509438 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5640d8d9-760d-4d99-8c27-a9ea17cf1c88 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:14.509877 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5640d8d9-760d-4d99-8c27-a9ea17cf1c88 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:14.548570 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-c830b695-a934-4873-a1d0-853a75db20f5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:14.549664 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-c830b695-a934-4873-a1d0-853a75db20f5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:14.556654 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c830b695-a934-4873-a1d0-853a75db20f5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:14.557296 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c830b695-a934-4873-a1d0-853a75db20f5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:14.557867 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c830b695-a934-4873-a1d0-853a75db20f5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:14.558748 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c830b695-a934-4873-a1d0-853a75db20f5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:14.559305 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c830b695-a934-4873-a1d0-853a75db20f5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:14.559850 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c830b695-a934-4873-a1d0-853a75db20f5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:14.654226 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5640d8d9-760d-4d99-8c27-a9ea17cf1c88 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:14.663316 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-5640d8d9-760d-4d99-8c27-a9ea17cf1c88 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1523 microversion: 2.1 time: 0.167762 Aug 09 18:51:14.664244 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 165/322] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:14 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:14.713613 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-c830b695-a934-4873-a1d0-853a75db20f5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:14.722008 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-c830b695-a934-4873-a1d0-853a75db20f5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1723 microversion: 2.1 time: 0.177598 Aug 09 18:51:14.727531 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 158/323] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:14 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:15.002736 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5d697449-b372-489b-820d-4a86b7b8f892 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:15.003491 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-5d697449-b372-489b-820d-4a86b7b8f892 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:15.009588 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5d697449-b372-489b-820d-4a86b7b8f892 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:15.010111 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5d697449-b372-489b-820d-4a86b7b8f892 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:15.010576 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5d697449-b372-489b-820d-4a86b7b8f892 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:15.011434 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5d697449-b372-489b-820d-4a86b7b8f892 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:15.011882 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5d697449-b372-489b-820d-4a86b7b8f892 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:15.012308 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5d697449-b372-489b-820d-4a86b7b8f892 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:15.147612 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5d697449-b372-489b-820d-4a86b7b8f892 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:15.155199 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-5d697449-b372-489b-820d-4a86b7b8f892 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1259 microversion: 2.1 time: 0.156868 Aug 09 18:51:15.156579 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 166/324] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:14 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:15.360957 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-da078747-859d-4441-978f-df809ecbbd86 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:15.361618 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-da078747-859d-4441-978f-df809ecbbd86 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:15.368288 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-da078747-859d-4441-978f-df809ecbbd86 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:15.368781 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-da078747-859d-4441-978f-df809ecbbd86 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:15.369214 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-da078747-859d-4441-978f-df809ecbbd86 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:15.369955 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-da078747-859d-4441-978f-df809ecbbd86 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:15.370414 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-da078747-859d-4441-978f-df809ecbbd86 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:15.371468 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-da078747-859d-4441-978f-df809ecbbd86 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:15.540269 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-da078747-859d-4441-978f-df809ecbbd86 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:15.550223 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-da078747-859d-4441-978f-df809ecbbd86 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:15.551772 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-da078747-859d-4441-978f-df809ecbbd86 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:15.552963 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-da078747-859d-4441-978f-df809ecbbd86 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1738 microversion: 2.20 time: 0.196618 Aug 09 18:51:15.553569 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 159/325] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:15 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1738 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:51:15.684463 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-8f27820e-b664-43a5-b28e-173cd4a3471d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:15.685022 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-8f27820e-b664-43a5-b28e-173cd4a3471d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:15.692129 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8f27820e-b664-43a5-b28e-173cd4a3471d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:15.692616 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8f27820e-b664-43a5-b28e-173cd4a3471d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:15.693038 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8f27820e-b664-43a5-b28e-173cd4a3471d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:15.693951 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8f27820e-b664-43a5-b28e-173cd4a3471d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:15.694390 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8f27820e-b664-43a5-b28e-173cd4a3471d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:15.694810 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8f27820e-b664-43a5-b28e-173cd4a3471d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:15.736683 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-105877df-4ffe-45b9-ab77-b2ea462f1889 req-2af09424-32cd-4f99-a44a-f72e7076b704 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22aac118-db08-4aca-a5e7-3f2cad5e49fd", "name": "network-vif-plugged", "status": "completed", "tag": "7a0b7c9e-84bf-4317-b8ea-f03780b0d3b2"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:51:15.750737 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-105877df-4ffe-45b9-ab77-b2ea462f1889 req-2af09424-32cd-4f99-a44a-f72e7076b704 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:15.751856 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-105877df-4ffe-45b9-ab77-b2ea462f1889 req-2af09424-32cd-4f99-a44a-f72e7076b704 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:15.752293 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-105877df-4ffe-45b9-ab77-b2ea462f1889 req-2af09424-32cd-4f99-a44a-f72e7076b704 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:15.771214 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-105877df-4ffe-45b9-ab77-b2ea462f1889 req-2af09424-32cd-4f99-a44a-f72e7076b704 service nova] Creating event network-vif-plugged:7a0b7c9e-84bf-4317-b8ea-f03780b0d3b2 for instance 22aac118-db08-4aca-a5e7-3f2cad5e49fd on hv-cinder-82660 Aug 09 18:51:15.778174 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-105877df-4ffe-45b9-ab77-b2ea462f1889 req-2af09424-32cd-4f99-a44a-f72e7076b704 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052311 Aug 09 18:51:15.778949 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 160/326] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:51:15.784932 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-12f5cfdc-5d83-4e84-a5c7-1f2d2c2767f2 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:15.785684 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-12f5cfdc-5d83-4e84-a5c7-1f2d2c2767f2 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:15.797672 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-12f5cfdc-5d83-4e84-a5c7-1f2d2c2767f2 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:15.803443 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-12f5cfdc-5d83-4e84-a5c7-1f2d2c2767f2 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:15.804483 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-12f5cfdc-5d83-4e84-a5c7-1f2d2c2767f2 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:15.805421 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-12f5cfdc-5d83-4e84-a5c7-1f2d2c2767f2 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:15.806076 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-12f5cfdc-5d83-4e84-a5c7-1f2d2c2767f2 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:15.806662 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-12f5cfdc-5d83-4e84-a5c7-1f2d2c2767f2 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:15.864944 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-8f27820e-b664-43a5-b28e-173cd4a3471d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:15.874448 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-8f27820e-b664-43a5-b28e-173cd4a3471d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1523 microversion: 2.1 time: 0.193995 Aug 09 18:51:15.891018 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 167/327] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:15 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1523 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:15.965618 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-12f5cfdc-5d83-4e84-a5c7-1f2d2c2767f2 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:15.980894 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-12f5cfdc-5d83-4e84-a5c7-1f2d2c2767f2 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1723 microversion: 2.1 time: 0.200559 Aug 09 18:51:15.994861 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 161/328] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:15 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:16.185189 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-813769aa-b8d2-46ff-9ef8-ddc5eecf11cf tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:16.186193 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-813769aa-b8d2-46ff-9ef8-ddc5eecf11cf tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:16.195238 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-813769aa-b8d2-46ff-9ef8-ddc5eecf11cf tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:16.196382 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-813769aa-b8d2-46ff-9ef8-ddc5eecf11cf tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:16.196965 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-813769aa-b8d2-46ff-9ef8-ddc5eecf11cf tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:16.197988 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-813769aa-b8d2-46ff-9ef8-ddc5eecf11cf tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:16.198583 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-813769aa-b8d2-46ff-9ef8-ddc5eecf11cf tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:16.206528 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-813769aa-b8d2-46ff-9ef8-ddc5eecf11cf tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:16.465822 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-813769aa-b8d2-46ff-9ef8-ddc5eecf11cf tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:16.469958 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=100 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:51:16.475051 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-813769aa-b8d2-46ff-9ef8-ddc5eecf11cf tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1259 microversion: 2.1 time: 0.293744 Aug 09 18:51:16.475698 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 168/329] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:16 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1259 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:16.581086 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-c0fe20ab-8c5f-42e0-a87f-8115187f74cd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:16.582523 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-c0fe20ab-8c5f-42e0-a87f-8115187f74cd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:16.590601 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c0fe20ab-8c5f-42e0-a87f-8115187f74cd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:16.591354 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c0fe20ab-8c5f-42e0-a87f-8115187f74cd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:16.596138 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c0fe20ab-8c5f-42e0-a87f-8115187f74cd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:16.598319 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c0fe20ab-8c5f-42e0-a87f-8115187f74cd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:16.598959 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c0fe20ab-8c5f-42e0-a87f-8115187f74cd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:16.599788 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c0fe20ab-8c5f-42e0-a87f-8115187f74cd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:16.832588 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-c0fe20ab-8c5f-42e0-a87f-8115187f74cd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:16.840765 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-c0fe20ab-8c5f-42e0-a87f-8115187f74cd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:16.842798 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-c0fe20ab-8c5f-42e0-a87f-8115187f74cd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:16.857770 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-c0fe20ab-8c5f-42e0-a87f-8115187f74cd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1738 microversion: 2.20 time: 0.272131 Aug 09 18:51:16.858238 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 162/330] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:16 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1738 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:51:16.897077 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-86cfa7c0-48f3-47f8-8fef-2739e60f4ec4 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:16.898033 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-86cfa7c0-48f3-47f8-8fef-2739e60f4ec4 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:16.905127 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-86cfa7c0-48f3-47f8-8fef-2739e60f4ec4 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:16.905685 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-86cfa7c0-48f3-47f8-8fef-2739e60f4ec4 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:16.906122 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-86cfa7c0-48f3-47f8-8fef-2739e60f4ec4 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:16.907400 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-86cfa7c0-48f3-47f8-8fef-2739e60f4ec4 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:16.907864 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-86cfa7c0-48f3-47f8-8fef-2739e60f4ec4 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:16.908293 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-86cfa7c0-48f3-47f8-8fef-2739e60f4ec4 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:17.006507 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-cd0a016b-21b8-4627-ab71-6676d8623879 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:17.007551 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-cd0a016b-21b8-4627-ab71-6676d8623879 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:17.029627 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cd0a016b-21b8-4627-ab71-6676d8623879 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:17.038827 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cd0a016b-21b8-4627-ab71-6676d8623879 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:17.039280 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cd0a016b-21b8-4627-ab71-6676d8623879 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:17.044275 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cd0a016b-21b8-4627-ab71-6676d8623879 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:17.044592 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cd0a016b-21b8-4627-ab71-6676d8623879 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:17.045083 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cd0a016b-21b8-4627-ab71-6676d8623879 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:17.096652 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-86cfa7c0-48f3-47f8-8fef-2739e60f4ec4 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:17.105732 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-86cfa7c0-48f3-47f8-8fef-2739e60f4ec4 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1523 microversion: 2.1 time: 0.213238 Aug 09 18:51:17.109582 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 169/331] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:16 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1523 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:17.203965 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-cd0a016b-21b8-4627-ab71-6676d8623879 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:17.214878 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-cd0a016b-21b8-4627-ab71-6676d8623879 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1723 microversion: 2.1 time: 0.212610 Aug 09 18:51:17.215553 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 163/332] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:17 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:51:17.502681 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-33659ae1-38f4-4b6a-af48-c5b67b354e4f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:17.503766 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-33659ae1-38f4-4b6a-af48-c5b67b354e4f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:17.510396 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-33659ae1-38f4-4b6a-af48-c5b67b354e4f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:17.511114 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-33659ae1-38f4-4b6a-af48-c5b67b354e4f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:17.511763 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-33659ae1-38f4-4b6a-af48-c5b67b354e4f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:17.512661 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-33659ae1-38f4-4b6a-af48-c5b67b354e4f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:17.513313 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-33659ae1-38f4-4b6a-af48-c5b67b354e4f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:17.514077 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-33659ae1-38f4-4b6a-af48-c5b67b354e4f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:17.677766 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-33659ae1-38f4-4b6a-af48-c5b67b354e4f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:17.685878 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-33659ae1-38f4-4b6a-af48-c5b67b354e4f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1259 microversion: 2.1 time: 0.193623 Aug 09 18:51:17.686453 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 170/333] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:17 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1259 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:17.822554 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-6d71c259-aa79-4b8f-bfad-9bed6b3d71e8 req-72e0a583-f89e-4324-a64d-9e44514e42bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7", "name": "network-vif-plugged", "status": "completed", "tag": "f4782f09-a0b0-4715-98fa-ea0d74933d8d"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:51:17.837666 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-6d71c259-aa79-4b8f-bfad-9bed6b3d71e8 req-72e0a583-f89e-4324-a64d-9e44514e42bd service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:17.838440 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-6d71c259-aa79-4b8f-bfad-9bed6b3d71e8 req-72e0a583-f89e-4324-a64d-9e44514e42bd service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:18.010014 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-6d71c259-aa79-4b8f-bfad-9bed6b3d71e8 req-72e0a583-f89e-4324-a64d-9e44514e42bd service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:18.010014 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-6d71c259-aa79-4b8f-bfad-9bed6b3d71e8 req-72e0a583-f89e-4324-a64d-9e44514e42bd service nova] Creating event network-vif-plugged:f4782f09-a0b0-4715-98fa-ea0d74933d8d for instance fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 on hv-cinder-82660 Aug 09 18:51:18.010014 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-6d71c259-aa79-4b8f-bfad-9bed6b3d71e8 req-72e0a583-f89e-4324-a64d-9e44514e42bd service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057979 Aug 09 18:51:18.010014 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 164/334] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:51:18.010980 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-00f39210-0664-400d-bcca-261bed89f7a7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:18.010980 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-00f39210-0664-400d-bcca-261bed89f7a7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:18.010980 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-00f39210-0664-400d-bcca-261bed89f7a7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:18.010980 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-00f39210-0664-400d-bcca-261bed89f7a7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:18.011830 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-00f39210-0664-400d-bcca-261bed89f7a7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:18.011830 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-00f39210-0664-400d-bcca-261bed89f7a7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:18.011830 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-00f39210-0664-400d-bcca-261bed89f7a7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:18.011830 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-00f39210-0664-400d-bcca-261bed89f7a7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:18.137916 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-29680e58-6e6b-4fc4-8416-d5fb6301895e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:18.138624 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-29680e58-6e6b-4fc4-8416-d5fb6301895e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:18.147018 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-29680e58-6e6b-4fc4-8416-d5fb6301895e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:18.152409 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-00f39210-0664-400d-bcca-261bed89f7a7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:18.158052 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-29680e58-6e6b-4fc4-8416-d5fb6301895e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:18.158556 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-29680e58-6e6b-4fc4-8416-d5fb6301895e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:18.159315 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-29680e58-6e6b-4fc4-8416-d5fb6301895e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:18.159787 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-29680e58-6e6b-4fc4-8416-d5fb6301895e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:18.160221 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-29680e58-6e6b-4fc4-8416-d5fb6301895e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:18.163828 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-00f39210-0664-400d-bcca-261bed89f7a7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:18.165452 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-00f39210-0664-400d-bcca-261bed89f7a7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:18.166883 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-00f39210-0664-400d-bcca-261bed89f7a7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1738 microversion: 2.20 time: 0.302530 Aug 09 18:51:18.182048 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 171/335] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:17 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1738 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:51:18.239788 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-38c6db89-f97d-4e16-9ef6-b5a30f91e8f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:18.240580 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-38c6db89-f97d-4e16-9ef6-b5a30f91e8f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:18.249134 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-38c6db89-f97d-4e16-9ef6-b5a30f91e8f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:18.250511 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-38c6db89-f97d-4e16-9ef6-b5a30f91e8f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:18.251079 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-38c6db89-f97d-4e16-9ef6-b5a30f91e8f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:18.251866 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-38c6db89-f97d-4e16-9ef6-b5a30f91e8f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:18.252556 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-38c6db89-f97d-4e16-9ef6-b5a30f91e8f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:18.253068 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-38c6db89-f97d-4e16-9ef6-b5a30f91e8f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:18.346939 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-29680e58-6e6b-4fc4-8416-d5fb6301895e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:18.355493 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-29680e58-6e6b-4fc4-8416-d5fb6301895e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1523 microversion: 2.1 time: 0.229061 Aug 09 18:51:18.365574 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 165/336] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:18 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1523 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:18.418020 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-38c6db89-f97d-4e16-9ef6-b5a30f91e8f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:18.427646 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-38c6db89-f97d-4e16-9ef6-b5a30f91e8f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1723 microversion: 2.1 time: 0.194699 Aug 09 18:51:18.428238 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 172/337] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:18 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:51:18.712743 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-f3d20e4d-4775-42ad-a523-bfe3e85b0f1c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:18.713356 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-f3d20e4d-4775-42ad-a523-bfe3e85b0f1c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:18.720129 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f3d20e4d-4775-42ad-a523-bfe3e85b0f1c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:18.720589 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f3d20e4d-4775-42ad-a523-bfe3e85b0f1c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:18.721022 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f3d20e4d-4775-42ad-a523-bfe3e85b0f1c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:18.721748 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f3d20e4d-4775-42ad-a523-bfe3e85b0f1c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:18.722201 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f3d20e4d-4775-42ad-a523-bfe3e85b0f1c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:18.722623 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f3d20e4d-4775-42ad-a523-bfe3e85b0f1c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:18.871459 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-f3d20e4d-4775-42ad-a523-bfe3e85b0f1c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:18.879100 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-f3d20e4d-4775-42ad-a523-bfe3e85b0f1c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1259 microversion: 2.1 time: 0.170513 Aug 09 18:51:18.879653 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 166/338] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:18 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:19.191490 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-df7b4ed8-6c07-4104-b473-857a48905fbd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:19.192115 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-df7b4ed8-6c07-4104-b473-857a48905fbd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:19.202659 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-df7b4ed8-6c07-4104-b473-857a48905fbd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:19.211937 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-df7b4ed8-6c07-4104-b473-857a48905fbd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:19.211937 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-df7b4ed8-6c07-4104-b473-857a48905fbd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:19.211937 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-df7b4ed8-6c07-4104-b473-857a48905fbd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:19.211937 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-df7b4ed8-6c07-4104-b473-857a48905fbd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:19.213218 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-df7b4ed8-6c07-4104-b473-857a48905fbd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:19.386315 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-436574e3-e038-4024-9fd8-c7c589eca5ae tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:19.387512 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-436574e3-e038-4024-9fd8-c7c589eca5ae tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:19.388027 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-df7b4ed8-6c07-4104-b473-857a48905fbd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:19.397562 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-436574e3-e038-4024-9fd8-c7c589eca5ae tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:19.397969 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-df7b4ed8-6c07-4104-b473-857a48905fbd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:19.399850 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-df7b4ed8-6c07-4104-b473-857a48905fbd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:19.400534 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-436574e3-e038-4024-9fd8-c7c589eca5ae tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:19.401151 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-436574e3-e038-4024-9fd8-c7c589eca5ae tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:19.401376 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-df7b4ed8-6c07-4104-b473-857a48905fbd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1738 microversion: 2.20 time: 0.214479 Aug 09 18:51:19.402407 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 173/339] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:19 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1738 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:51:19.407462 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-436574e3-e038-4024-9fd8-c7c589eca5ae tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:19.408013 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-436574e3-e038-4024-9fd8-c7c589eca5ae tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:19.408512 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-436574e3-e038-4024-9fd8-c7c589eca5ae tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:19.432352 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell1:SELECT=100 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:51:19.453721 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d4d6243f-07c6-4d93-a3f4-2ea212caecaa tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:19.454408 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-d4d6243f-07c6-4d93-a3f4-2ea212caecaa tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:19.466118 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d4d6243f-07c6-4d93-a3f4-2ea212caecaa tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:19.469320 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d4d6243f-07c6-4d93-a3f4-2ea212caecaa tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:19.469944 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d4d6243f-07c6-4d93-a3f4-2ea212caecaa tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:19.471085 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d4d6243f-07c6-4d93-a3f4-2ea212caecaa tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:19.473513 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d4d6243f-07c6-4d93-a3f4-2ea212caecaa tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:19.476201 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d4d6243f-07c6-4d93-a3f4-2ea212caecaa tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:19.638899 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-436574e3-e038-4024-9fd8-c7c589eca5ae tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:19.646678 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-436574e3-e038-4024-9fd8-c7c589eca5ae tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1523 microversion: 2.1 time: 0.264337 Aug 09 18:51:19.651392 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 167/340] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:19 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1523 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:51:19.665863 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d4d6243f-07c6-4d93-a3f4-2ea212caecaa tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:19.676628 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-d4d6243f-07c6-4d93-a3f4-2ea212caecaa tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1723 microversion: 2.1 time: 0.229138 Aug 09 18:51:19.690628 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 174/341] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:19 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:19.903326 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-3c9d6e04-4ed6-4e0c-8fd5-b65c59673d37 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:19.903956 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-3c9d6e04-4ed6-4e0c-8fd5-b65c59673d37 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:19.910980 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3c9d6e04-4ed6-4e0c-8fd5-b65c59673d37 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:19.911483 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3c9d6e04-4ed6-4e0c-8fd5-b65c59673d37 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:19.911916 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3c9d6e04-4ed6-4e0c-8fd5-b65c59673d37 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:19.912612 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3c9d6e04-4ed6-4e0c-8fd5-b65c59673d37 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:19.913308 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3c9d6e04-4ed6-4e0c-8fd5-b65c59673d37 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:19.914288 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3c9d6e04-4ed6-4e0c-8fd5-b65c59673d37 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:20.113357 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-3c9d6e04-4ed6-4e0c-8fd5-b65c59673d37 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:20.123103 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-3c9d6e04-4ed6-4e0c-8fd5-b65c59673d37 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1259 microversion: 2.1 time: 0.225416 Aug 09 18:51:20.123903 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 168/342] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:19 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1259 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:20.427633 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-79c38134-8257-4ec5-834d-e1fc1e774e2a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:20.428185 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-79c38134-8257-4ec5-834d-e1fc1e774e2a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:20.434902 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-79c38134-8257-4ec5-834d-e1fc1e774e2a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:20.435724 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-79c38134-8257-4ec5-834d-e1fc1e774e2a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:20.436411 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-79c38134-8257-4ec5-834d-e1fc1e774e2a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:20.438073 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-79c38134-8257-4ec5-834d-e1fc1e774e2a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:20.438766 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-79c38134-8257-4ec5-834d-e1fc1e774e2a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:20.439393 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-79c38134-8257-4ec5-834d-e1fc1e774e2a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:20.618437 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-79c38134-8257-4ec5-834d-e1fc1e774e2a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:20.628726 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-79c38134-8257-4ec5-834d-e1fc1e774e2a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:20.630259 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-79c38134-8257-4ec5-834d-e1fc1e774e2a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:20.634336 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-79c38134-8257-4ec5-834d-e1fc1e774e2a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1738 microversion: 2.20 time: 0.208285 Aug 09 18:51:20.646768 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 175/343] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:20 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1738 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:51:20.675121 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-9152e901-9220-4271-8872-f87f29fe5acd tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:20.675121 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-9152e901-9220-4271-8872-f87f29fe5acd tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:20.682781 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9152e901-9220-4271-8872-f87f29fe5acd tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:20.683224 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9152e901-9220-4271-8872-f87f29fe5acd tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:20.683662 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9152e901-9220-4271-8872-f87f29fe5acd tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:20.684381 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9152e901-9220-4271-8872-f87f29fe5acd tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:20.684845 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9152e901-9220-4271-8872-f87f29fe5acd tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:20.685293 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9152e901-9220-4271-8872-f87f29fe5acd tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:20.699471 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-1d052836-36d6-4f87-86bd-9f830a91a23d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:20.700587 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-1d052836-36d6-4f87-86bd-9f830a91a23d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:20.712025 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1d052836-36d6-4f87-86bd-9f830a91a23d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:20.713268 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1d052836-36d6-4f87-86bd-9f830a91a23d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:20.714113 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1d052836-36d6-4f87-86bd-9f830a91a23d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:20.715085 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1d052836-36d6-4f87-86bd-9f830a91a23d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:20.715787 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1d052836-36d6-4f87-86bd-9f830a91a23d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:20.716395 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1d052836-36d6-4f87-86bd-9f830a91a23d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:20.865578 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-9152e901-9220-4271-8872-f87f29fe5acd tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:20.874325 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-9152e901-9220-4271-8872-f87f29fe5acd tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1523 microversion: 2.1 time: 0.206928 Aug 09 18:51:20.879733 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 169/344] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:20 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1523 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:20.906455 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1d052836-36d6-4f87-86bd-9f830a91a23d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:20.914737 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-1d052836-36d6-4f87-86bd-9f830a91a23d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1723 microversion: 2.1 time: 0.219934 Aug 09 18:51:20.915312 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 176/345] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:20 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:51:21.144698 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-81f58a33-dc97-426b-9c6c-bf81041df68c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:21.146085 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-81f58a33-dc97-426b-9c6c-bf81041df68c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:21.153464 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-81f58a33-dc97-426b-9c6c-bf81041df68c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:21.154370 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-81f58a33-dc97-426b-9c6c-bf81041df68c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:21.154885 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-81f58a33-dc97-426b-9c6c-bf81041df68c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:21.155665 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-81f58a33-dc97-426b-9c6c-bf81041df68c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:21.156653 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-81f58a33-dc97-426b-9c6c-bf81041df68c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:21.157069 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-81f58a33-dc97-426b-9c6c-bf81041df68c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:21.325404 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-81f58a33-dc97-426b-9c6c-bf81041df68c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:21.340566 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-81f58a33-dc97-426b-9c6c-bf81041df68c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1442 microversion: 2.1 time: 0.200187 Aug 09 18:51:21.341161 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 170/346] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:21 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1442 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:21.363600 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-87b45a49-39bf-414a-ae69-dfe7a0ee8b1c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:21.364469 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-87b45a49-39bf-414a-ae69-dfe7a0ee8b1c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:21.371040 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-87b45a49-39bf-414a-ae69-dfe7a0ee8b1c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:21.371720 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-87b45a49-39bf-414a-ae69-dfe7a0ee8b1c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:21.372158 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-87b45a49-39bf-414a-ae69-dfe7a0ee8b1c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:21.372865 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-87b45a49-39bf-414a-ae69-dfe7a0ee8b1c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:21.375218 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-87b45a49-39bf-414a-ae69-dfe7a0ee8b1c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:21.375218 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-87b45a49-39bf-414a-ae69-dfe7a0ee8b1c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:21.610031 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-87b45a49-39bf-414a-ae69-dfe7a0ee8b1c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:21.622480 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-87b45a49-39bf-414a-ae69-dfe7a0ee8b1c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1442 microversion: 2.1 time: 0.263033 Aug 09 18:51:21.626060 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 177/347] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:21 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1442 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:21.666447 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-af7e9e13-6d42-494c-9ed9-b3982a3275a3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:21.670945 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-af7e9e13-6d42-494c-9ed9-b3982a3275a3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:21.695467 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-af7e9e13-6d42-494c-9ed9-b3982a3275a3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:21.696257 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-af7e9e13-6d42-494c-9ed9-b3982a3275a3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:21.696965 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-af7e9e13-6d42-494c-9ed9-b3982a3275a3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:21.697960 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-af7e9e13-6d42-494c-9ed9-b3982a3275a3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:21.698836 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-af7e9e13-6d42-494c-9ed9-b3982a3275a3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:21.699630 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-af7e9e13-6d42-494c-9ed9-b3982a3275a3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:21.902457 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-fd568199-567d-4d36-9edb-67e9409c0219 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:21.903126 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-fd568199-567d-4d36-9edb-67e9409c0219 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:21.909761 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fd568199-567d-4d36-9edb-67e9409c0219 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:21.910262 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fd568199-567d-4d36-9edb-67e9409c0219 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:21.910699 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fd568199-567d-4d36-9edb-67e9409c0219 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:21.911574 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fd568199-567d-4d36-9edb-67e9409c0219 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:21.912040 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fd568199-567d-4d36-9edb-67e9409c0219 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:21.912493 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fd568199-567d-4d36-9edb-67e9409c0219 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:21.997334 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-af7e9e13-6d42-494c-9ed9-b3982a3275a3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:22.009664 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-af7e9e13-6d42-494c-9ed9-b3982a3275a3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:22.017698 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-af7e9e13-6d42-494c-9ed9-b3982a3275a3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:22.017698 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-af7e9e13-6d42-494c-9ed9-b3982a3275a3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1738 microversion: 2.20 time: 0.358896 Aug 09 18:51:22.017698 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 171/348] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:21 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1738 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:51:22.019356 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-dee66274-4a4a-4f79-ac4c-cf070238ae3a tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:22.019989 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-dee66274-4a4a-4f79-ac4c-cf070238ae3a tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:22.026452 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-dee66274-4a4a-4f79-ac4c-cf070238ae3a tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:22.026937 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-dee66274-4a4a-4f79-ac4c-cf070238ae3a tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:22.027364 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-dee66274-4a4a-4f79-ac4c-cf070238ae3a tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:22.028225 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-dee66274-4a4a-4f79-ac4c-cf070238ae3a tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:22.028772 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-dee66274-4a4a-4f79-ac4c-cf070238ae3a tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:22.029279 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-dee66274-4a4a-4f79-ac4c-cf070238ae3a tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:22.113853 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-fd568199-567d-4d36-9edb-67e9409c0219 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:22.114987 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-fd568199-567d-4d36-9edb-67e9409c0219 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1523 microversion: 2.1 time: 0.217689 Aug 09 18:51:22.115867 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 178/349] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:21 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1523 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:22.251567 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-dee66274-4a4a-4f79-ac4c-cf070238ae3a tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:22.286919 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-dee66274-4a4a-4f79-ac4c-cf070238ae3a tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1723 microversion: 2.1 time: 0.272168 Aug 09 18:51:22.289985 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 172/350] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:22 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1723 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:23.036502 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-0f5395f5-015d-44b8-88ba-3b916487ccbd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:23.037904 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-0f5395f5-015d-44b8-88ba-3b916487ccbd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:23.070435 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0f5395f5-015d-44b8-88ba-3b916487ccbd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:23.070936 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0f5395f5-015d-44b8-88ba-3b916487ccbd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:23.077144 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0f5395f5-015d-44b8-88ba-3b916487ccbd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:23.078728 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0f5395f5-015d-44b8-88ba-3b916487ccbd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:23.079302 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0f5395f5-015d-44b8-88ba-3b916487ccbd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:23.079734 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0f5395f5-015d-44b8-88ba-3b916487ccbd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:23.137915 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-9df06025-a904-440c-bf86-f8691e5e0bcf tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:23.138881 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-9df06025-a904-440c-bf86-f8691e5e0bcf tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:23.151931 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9df06025-a904-440c-bf86-f8691e5e0bcf tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:23.152862 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9df06025-a904-440c-bf86-f8691e5e0bcf tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:23.153479 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9df06025-a904-440c-bf86-f8691e5e0bcf tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:23.157669 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9df06025-a904-440c-bf86-f8691e5e0bcf tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:23.159404 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9df06025-a904-440c-bf86-f8691e5e0bcf tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:23.159971 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9df06025-a904-440c-bf86-f8691e5e0bcf tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:23.384549 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-9df06025-a904-440c-bf86-f8691e5e0bcf tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:23.396572 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-9df06025-a904-440c-bf86-f8691e5e0bcf tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1523 microversion: 2.1 time: 0.262402 Aug 09 18:51:23.398899 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 173/351] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:23 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1523 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:23.404287 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-cf6e259c-bd87-435f-9ed3-b330e44d1785 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:23.405145 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-cf6e259c-bd87-435f-9ed3-b330e44d1785 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:23.417489 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cf6e259c-bd87-435f-9ed3-b330e44d1785 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:23.418291 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cf6e259c-bd87-435f-9ed3-b330e44d1785 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:23.418921 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cf6e259c-bd87-435f-9ed3-b330e44d1785 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:23.419811 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cf6e259c-bd87-435f-9ed3-b330e44d1785 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:23.420530 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cf6e259c-bd87-435f-9ed3-b330e44d1785 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:23.421233 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cf6e259c-bd87-435f-9ed3-b330e44d1785 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:23.428366 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-0f5395f5-015d-44b8-88ba-3b916487ccbd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:23.443624 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-0f5395f5-015d-44b8-88ba-3b916487ccbd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:23.445842 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-0f5395f5-015d-44b8-88ba-3b916487ccbd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:23.449371 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-0f5395f5-015d-44b8-88ba-3b916487ccbd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1738 microversion: 2.20 time: 0.416965 Aug 09 18:51:23.463261 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 179/352] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:23 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1738 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:51:23.633217 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-cf6e259c-bd87-435f-9ed3-b330e44d1785 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:23.645636 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-cf6e259c-bd87-435f-9ed3-b330e44d1785 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1700 microversion: 2.1 time: 0.245473 Aug 09 18:51:23.661954 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 174/353] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:23 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1700 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:23.669210 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-0e57c630-9e81-4293-91e8-9da86fd1871e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:51:23.676965 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0e57c630-9e81-4293-91e8-9da86fd1871e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:23.677450 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0e57c630-9e81-4293-91e8-9da86fd1871e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:23.678395 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0e57c630-9e81-4293-91e8-9da86fd1871e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:23.757783 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-0e57c630-9e81-4293-91e8-9da86fd1871e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Going to try to start instance {{(pid=124725) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 09 18:51:23.987705 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-0e57c630-9e81-4293-91e8-9da86fd1871e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "POST /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af/action" status: 202 len: 0 microversion: 2.1 time: 0.322989 Aug 09 18:51:23.989730 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 180/354] 10.222.0.57 () {60 vars in 1278 bytes} [Tue Aug 9 18:51:23 2022] POST /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:51:23.999691 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-8100fb8a-cff7-4dbd-b821-15bce85ca4dd tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:24.000498 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-8100fb8a-cff7-4dbd-b821-15bce85ca4dd tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:24.007421 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-8100fb8a-cff7-4dbd-b821-15bce85ca4dd tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:24.008032 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-8100fb8a-cff7-4dbd-b821-15bce85ca4dd tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:24.008808 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-8100fb8a-cff7-4dbd-b821-15bce85ca4dd tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:24.010521 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-8100fb8a-cff7-4dbd-b821-15bce85ca4dd tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:24.010521 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-8100fb8a-cff7-4dbd-b821-15bce85ca4dd tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:24.011042 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-8100fb8a-cff7-4dbd-b821-15bce85ca4dd tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:24.326388 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-8100fb8a-cff7-4dbd-b821-15bce85ca4dd tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:24.336674 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-8100fb8a-cff7-4dbd-b821-15bce85ca4dd tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1709 microversion: 2.1 time: 0.341093 Aug 09 18:51:24.337710 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 175/355] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:23 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1709 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:24.424512 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e787bfd7-ac53-4db6-9371-fde732f132ad tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:24.425106 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e787bfd7-ac53-4db6-9371-fde732f132ad tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:24.443458 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e787bfd7-ac53-4db6-9371-fde732f132ad tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:24.447209 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e787bfd7-ac53-4db6-9371-fde732f132ad tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:24.457439 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e787bfd7-ac53-4db6-9371-fde732f132ad tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:24.459677 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e787bfd7-ac53-4db6-9371-fde732f132ad tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:24.460794 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e787bfd7-ac53-4db6-9371-fde732f132ad tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:24.461798 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e787bfd7-ac53-4db6-9371-fde732f132ad tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:24.482777 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-e3c2751f-0e6d-469e-8460-627b3415eded tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:24.483289 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-e3c2751f-0e6d-469e-8460-627b3415eded tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:24.489255 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_api:SELECT=100 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:51:24.492673 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e3c2751f-0e6d-469e-8460-627b3415eded tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:24.494574 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e3c2751f-0e6d-469e-8460-627b3415eded tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:24.496267 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e3c2751f-0e6d-469e-8460-627b3415eded tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:24.497102 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e3c2751f-0e6d-469e-8460-627b3415eded tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:24.500524 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e3c2751f-0e6d-469e-8460-627b3415eded tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:24.501143 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e3c2751f-0e6d-469e-8460-627b3415eded tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:24.740034 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e787bfd7-ac53-4db6-9371-fde732f132ad tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:24.750246 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e787bfd7-ac53-4db6-9371-fde732f132ad tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1503 microversion: 2.1 time: 0.330363 Aug 09 18:51:24.751008 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 181/356] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:24 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1503 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:24.778304 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-ce9df670-6242-48a2-8032-181715684430 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b8245fd7-83cb-4a24-b4e3-3f0a991f90b4"}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:51:24.780967 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-ce9df670-6242-48a2-8032-181715684430 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:24.794186 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ce9df670-6242-48a2-8032-181715684430 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:24.794719 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ce9df670-6242-48a2-8032-181715684430 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:24.795169 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ce9df670-6242-48a2-8032-181715684430 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:24.796956 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ce9df670-6242-48a2-8032-181715684430 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:24.800316 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ce9df670-6242-48a2-8032-181715684430 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:24.801023 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ce9df670-6242-48a2-8032-181715684430 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:24.841441 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-ce9df670-6242-48a2-8032-181715684430 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] HTTP exception thrown: Cannot 'attach_volume' instance 650af48c-836d-4078-abb6-4b865a22a7d8 while it is in vm_state rescued Aug 09 18:51:24.844218 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-ce9df670-6242-48a2-8032-181715684430 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Request method failure captured: Aug 09 18:51:24.844218 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: request: POST /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8/os-volume_attachments HTTP/1.1 Aug 09 18:51:24.844218 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept: application/json Aug 09 18:51:24.844218 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Aug 09 18:51:24.844218 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Connection: close Aug 09 18:51:24.844218 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Length: 74 Aug 09 18:51:24.844218 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Type: application/json Aug 09 18:51:24.844218 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Host: 10.222.0.57 Aug 09 18:51:24.844218 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Aug 09 18:51:24.844218 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.11 Aug 09 18:51:24.844218 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABi8qwcYn_PR1bY-m21eiDaM-K65e27GCgB1hyw1OuGXRk37b51HFhla9CV-9Ypj2nAUtt--h-xdiAP9q3XcmfWWUfjCi-I0NaYuSy2aQQRGG3_zykXOBy5GJW4FO-NWWjB3ENfbKd8Tz-WldjUgCB_nawpLyJ7FUR9ShKkFO_khGgJwfI Aug 09 18:51:24.844218 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Aug 09 18:51:24.844218 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Aug 09 18:51:24.844218 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Aug 09 18:51:24.844218 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Aug 09 18:51:24.844218 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Aug 09 18:51:24.844218 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Aug 09 18:51:24.844218 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Id: d3c7915d78334e95a41a32f0f3b5b084 Aug 09 18:51:24.844218 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-687112300 Aug 09 18:51:24.844218 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Role: reader,member Aug 09 18:51:24.844218 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Roles: reader,member Aug 09 18:51:24.845595 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d3c7915d78334e95a41a32f0f3b5b084", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d3c7915d78334e95a41a32f0f3b5b084"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d3c7915d78334e95a41a32f0f3b5b084"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d3c7915d78334e95a41a32f0f3b5b084"}]}] Aug 09 18:51:24.845595 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-ServerRescueNegativeTestJSON-687112300 Aug 09 18:51:24.845595 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Id: d3c7915d78334e95a41a32f0f3b5b084 Aug 09 18:51:24.845595 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-687112300 Aug 09 18:51:24.845595 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User: tempest-ServerRescueNegativeTestJSON-687112300-project Aug 09 18:51:24.845595 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Aug 09 18:51:24.845595 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Aug 09 18:51:24.845595 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Id: 04da0f4276d6457c889ecb3006842e9c Aug 09 18:51:24.845595 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-ServerRescueNegativeTestJSON-687112300-project Aug 09 18:51:24.845595 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Aug 09 18:51:24.845595 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: {"volumeAttachment": {"volumeId": "b8245fd7-83cb-4a24-b4e3-3f0a991f90b4"}} Aug 09 18:51:24.845595 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: method: > Aug 09 18:51:24.846374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: exception: Cannot 'attach_volume' instance 650af48c-836d-4078-abb6-4b865a22a7d8 while it is in vm_state rescued Aug 09 18:51:24.846374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: action_args: {'server_id': '650af48c-836d-4078-abb6-4b865a22a7d8', 'body': {'volumeAttachment': {'volumeId': 'b8245fd7-83cb-4a24-b4e3-3f0a991f90b4'}}} Aug 09 18:51:24.846374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:51:24.846374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:51:24.846374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 09 18:51:24.846374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 09 18:51:24.846374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 18:51:24.846374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 18:51:24.846374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 18:51:24.846374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 18:51:24.846374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 650af48c-836d-4078-abb6-4b865a22a7d8 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 09 18:51:24.846374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:51:24.846374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:51:24.846374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:51:24.846374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:51:24.846374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:51:24.846374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:51:24.846374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:51:24.846374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:51:24.847487 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:51:24.847487 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:51:24.847487 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 18:51:24.847487 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 18:51:24.847487 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 18:51:24.847487 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 18:51:24.847487 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 18:51:24.847487 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 18:51:24.847487 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 09 18:51:24.847487 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 18:51:24.847487 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 18:51:24.847487 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 18:51:24.847487 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 650af48c-836d-4078-abb6-4b865a22a7d8 while it is in vm_state rescued Aug 09 18:51:24.847487 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:51:24.847487 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:51:24.847487 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:51:24.847487 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:51:24.847487 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:51:24.847487 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:51:24.848600 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:51:24.848600 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:51:24.848600 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 650af48c-836d-4078-abb6-4b865a22a7d8 while it is in vm_state rescued Aug 09 18:51:24.848600 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:51:24.850497 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-ce9df670-6242-48a2-8032-181715684430 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Returning 409 to user: Cannot 'attach_volume' instance 650af48c-836d-4078-abb6-4b865a22a7d8 while it is in vm_state rescued {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:51:24.851731 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-ce9df670-6242-48a2-8032-181715684430 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "POST /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.077579 Aug 09 18:51:24.853065 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 182/357] 10.222.0.57 () {60 vars in 1323 bytes} [Tue Aug 9 18:51:24 2022] POST /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8/os-volume_attachments => generated 152 bytes in 80 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 18:51:24.867197 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-e3c2751f-0e6d-469e-8460-627b3415eded tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:24.873238 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-59dc6767-9c67-4658-90f7-506c0ac6e1e0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:51:24.875771 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-59dc6767-9c67-4658-90f7-506c0ac6e1e0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:24.878511 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-e3c2751f-0e6d-469e-8460-627b3415eded tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:24.880024 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-e3c2751f-0e6d-469e-8460-627b3415eded tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:24.881228 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-e3c2751f-0e6d-469e-8460-627b3415eded tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1738 microversion: 2.20 time: 0.405181 Aug 09 18:51:24.883658 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-59dc6767-9c67-4658-90f7-506c0ac6e1e0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:24.884417 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-59dc6767-9c67-4658-90f7-506c0ac6e1e0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:24.885086 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-59dc6767-9c67-4658-90f7-506c0ac6e1e0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:24.886466 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-59dc6767-9c67-4658-90f7-506c0ac6e1e0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:24.887141 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-59dc6767-9c67-4658-90f7-506c0ac6e1e0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:24.888207 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-59dc6767-9c67-4658-90f7-506c0ac6e1e0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:24.896566 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 176/358] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:24 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1738 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:51:25.062131 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:51:25.157961 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-59dc6767-9c67-4658-90f7-506c0ac6e1e0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "POST /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8/action" status: 202 len: 0 microversion: 2.1 time: 0.283965 Aug 09 18:51:25.162256 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 183/359] 10.222.0.57 () {60 vars in 1278 bytes} [Tue Aug 9 18:51:24 2022] POST /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:51:25.170902 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-65861f36-d24a-420f-ab66-fe36abf31774 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:25.176825 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-65861f36-d24a-420f-ab66-fe36abf31774 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:25.185718 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-65861f36-d24a-420f-ab66-fe36abf31774 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:25.186223 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-65861f36-d24a-420f-ab66-fe36abf31774 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:25.186721 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-65861f36-d24a-420f-ab66-fe36abf31774 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:25.187439 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-65861f36-d24a-420f-ab66-fe36abf31774 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:25.187945 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-65861f36-d24a-420f-ab66-fe36abf31774 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:25.188547 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-65861f36-d24a-420f-ab66-fe36abf31774 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:25.330029 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-9fd732fc-b337-4b59-bba6-fe7d3232cedb req-86516aeb-cf63-4e9c-8be1-ecd9c729ea44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7", "tag": "f4782f09-a0b0-4715-98fa-ea0d74933d8d"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:51:25.353866 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-9fd732fc-b337-4b59-bba6-fe7d3232cedb req-86516aeb-cf63-4e9c-8be1-ecd9c729ea44 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:25.364296 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-9fd732fc-b337-4b59-bba6-fe7d3232cedb req-86516aeb-cf63-4e9c-8be1-ecd9c729ea44 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:25.364296 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-9fd732fc-b337-4b59-bba6-fe7d3232cedb req-86516aeb-cf63-4e9c-8be1-ecd9c729ea44 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:25.375361 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-9fd732fc-b337-4b59-bba6-fe7d3232cedb req-86516aeb-cf63-4e9c-8be1-ecd9c729ea44 service nova] Creating event network-changed:f4782f09-a0b0-4715-98fa-ea0d74933d8d for instance fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 on hv-cinder-82660 Aug 09 18:51:25.387732 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-9fd732fc-b337-4b59-bba6-fe7d3232cedb req-86516aeb-cf63-4e9c-8be1-ecd9c729ea44 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061789 Aug 09 18:51:25.391576 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 184/360] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:51:25.403167 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-fb480489-2201-4b9d-b7a4-2d960f1981bb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:25.403782 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-fb480489-2201-4b9d-b7a4-2d960f1981bb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:25.414896 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fb480489-2201-4b9d-b7a4-2d960f1981bb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:25.415390 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fb480489-2201-4b9d-b7a4-2d960f1981bb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:25.415823 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fb480489-2201-4b9d-b7a4-2d960f1981bb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:25.416541 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fb480489-2201-4b9d-b7a4-2d960f1981bb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:25.417000 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fb480489-2201-4b9d-b7a4-2d960f1981bb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:25.417483 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fb480489-2201-4b9d-b7a4-2d960f1981bb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:26.081916 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-fb480489-2201-4b9d-b7a4-2d960f1981bb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:26.097133 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-fb480489-2201-4b9d-b7a4-2d960f1981bb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1709 microversion: 2.1 time: 0.697828 Aug 09 18:51:26.100892 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 185/361] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:25 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1709 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:26.120170 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-1aaab2a4-8726-4042-87e3-d389e8341b48 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:26.121470 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-1aaab2a4-8726-4042-87e3-d389e8341b48 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:26.131378 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-65861f36-d24a-420f-ab66-fe36abf31774 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:26.139930 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-65861f36-d24a-420f-ab66-fe36abf31774 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1511 microversion: 2.1 time: 0.974998 Aug 09 18:51:26.143912 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 177/362] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:25 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1511 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:51:26.162182 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1aaab2a4-8726-4042-87e3-d389e8341b48 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:26.162684 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1aaab2a4-8726-4042-87e3-d389e8341b48 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:26.163908 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1aaab2a4-8726-4042-87e3-d389e8341b48 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:26.164924 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1aaab2a4-8726-4042-87e3-d389e8341b48 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:26.165615 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1aaab2a4-8726-4042-87e3-d389e8341b48 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:26.166638 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1aaab2a4-8726-4042-87e3-d389e8341b48 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:26.390468 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1aaab2a4-8726-4042-87e3-d389e8341b48 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:26.418612 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1aaab2a4-8726-4042-87e3-d389e8341b48 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:26.428443 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1aaab2a4-8726-4042-87e3-d389e8341b48 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:26.430215 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-1aaab2a4-8726-4042-87e3-d389e8341b48 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1738 microversion: 2.20 time: 0.327603 Aug 09 18:51:26.442900 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 186/363] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:26 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1738 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:51:27.119601 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-c35386f8-ab5a-46fd-bcb2-3806f8b1224c tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:27.120241 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-c35386f8-ab5a-46fd-bcb2-3806f8b1224c tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:27.127071 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c35386f8-ab5a-46fd-bcb2-3806f8b1224c tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:27.127573 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c35386f8-ab5a-46fd-bcb2-3806f8b1224c tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:27.128023 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c35386f8-ab5a-46fd-bcb2-3806f8b1224c tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:27.128725 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c35386f8-ab5a-46fd-bcb2-3806f8b1224c tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:27.129360 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c35386f8-ab5a-46fd-bcb2-3806f8b1224c tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:27.130010 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c35386f8-ab5a-46fd-bcb2-3806f8b1224c tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:27.164696 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-9135e80c-137b-450e-bd1f-e6cd8b7c2a8c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:27.185246 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-9135e80c-137b-450e-bd1f-e6cd8b7c2a8c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:27.213035 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9135e80c-137b-450e-bd1f-e6cd8b7c2a8c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:27.216364 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9135e80c-137b-450e-bd1f-e6cd8b7c2a8c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:27.220687 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9135e80c-137b-450e-bd1f-e6cd8b7c2a8c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:27.221763 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9135e80c-137b-450e-bd1f-e6cd8b7c2a8c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:27.222734 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9135e80c-137b-450e-bd1f-e6cd8b7c2a8c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:27.223344 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9135e80c-137b-450e-bd1f-e6cd8b7c2a8c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:27.305125 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-c35386f8-ab5a-46fd-bcb2-3806f8b1224c tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:27.316712 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-c35386f8-ab5a-46fd-bcb2-3806f8b1224c tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1709 microversion: 2.1 time: 0.198869 Aug 09 18:51:27.316712 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 178/364] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:27 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1709 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:27.475558 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-0c3ffe6f-9c15-40ca-a365-f1788a800ef4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:27.477097 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-0c3ffe6f-9c15-40ca-a365-f1788a800ef4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:27.487484 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0c3ffe6f-9c15-40ca-a365-f1788a800ef4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:27.491020 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0c3ffe6f-9c15-40ca-a365-f1788a800ef4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:27.491020 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0c3ffe6f-9c15-40ca-a365-f1788a800ef4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:27.491020 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0c3ffe6f-9c15-40ca-a365-f1788a800ef4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:27.491020 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0c3ffe6f-9c15-40ca-a365-f1788a800ef4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:27.491408 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0c3ffe6f-9c15-40ca-a365-f1788a800ef4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:27.496352 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-9135e80c-137b-450e-bd1f-e6cd8b7c2a8c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:27.510273 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-9135e80c-137b-450e-bd1f-e6cd8b7c2a8c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1511 microversion: 2.1 time: 0.349493 Aug 09 18:51:27.519687 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 187/365] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:27 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1511 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:51:27.698258 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-0c3ffe6f-9c15-40ca-a365-f1788a800ef4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:27.707844 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-0c3ffe6f-9c15-40ca-a365-f1788a800ef4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:27.709441 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-0c3ffe6f-9c15-40ca-a365-f1788a800ef4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:27.710768 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-0c3ffe6f-9c15-40ca-a365-f1788a800ef4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1738 microversion: 2.20 time: 0.239180 Aug 09 18:51:27.711361 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 179/366] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:27 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1738 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:51:28.340422 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-1bb23538-a0a4-44bf-b1e2-719236b1a0d6 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:28.341110 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-1bb23538-a0a4-44bf-b1e2-719236b1a0d6 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:28.347897 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1bb23538-a0a4-44bf-b1e2-719236b1a0d6 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:28.348477 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1bb23538-a0a4-44bf-b1e2-719236b1a0d6 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:28.349046 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1bb23538-a0a4-44bf-b1e2-719236b1a0d6 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:28.349852 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1bb23538-a0a4-44bf-b1e2-719236b1a0d6 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:28.350370 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1bb23538-a0a4-44bf-b1e2-719236b1a0d6 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:28.350861 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1bb23538-a0a4-44bf-b1e2-719236b1a0d6 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:28.509006 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1bb23538-a0a4-44bf-b1e2-719236b1a0d6 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:28.517407 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-1bb23538-a0a4-44bf-b1e2-719236b1a0d6 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1713 microversion: 2.1 time: 0.181044 Aug 09 18:51:28.518701 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 188/367] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:28 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1713 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:28.550655 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-a5de16c3-19e9-40bf-af15-197dd78a8dc9 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:28.551271 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-a5de16c3-19e9-40bf-af15-197dd78a8dc9 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:28.560438 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a5de16c3-19e9-40bf-af15-197dd78a8dc9 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:28.561247 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a5de16c3-19e9-40bf-af15-197dd78a8dc9 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:28.562411 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a5de16c3-19e9-40bf-af15-197dd78a8dc9 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:28.563857 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a5de16c3-19e9-40bf-af15-197dd78a8dc9 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:28.564727 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a5de16c3-19e9-40bf-af15-197dd78a8dc9 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:28.565503 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a5de16c3-19e9-40bf-af15-197dd78a8dc9 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:28.714418 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-a5de16c3-19e9-40bf-af15-197dd78a8dc9 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:28.723461 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-a5de16c3-19e9-40bf-af15-197dd78a8dc9 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1511 microversion: 2.1 time: 0.178363 Aug 09 18:51:28.724579 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 180/368] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:28 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1511 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:28.736808 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-6947bf07-ebc9-4030-8334-71cbc47d473f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:28.737944 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-6947bf07-ebc9-4030-8334-71cbc47d473f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:28.747980 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6947bf07-ebc9-4030-8334-71cbc47d473f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:28.749306 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6947bf07-ebc9-4030-8334-71cbc47d473f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:28.749971 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6947bf07-ebc9-4030-8334-71cbc47d473f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:28.750894 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6947bf07-ebc9-4030-8334-71cbc47d473f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:28.751549 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6947bf07-ebc9-4030-8334-71cbc47d473f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:28.752272 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6947bf07-ebc9-4030-8334-71cbc47d473f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:28.934851 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-6947bf07-ebc9-4030-8334-71cbc47d473f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:28.945802 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-6947bf07-ebc9-4030-8334-71cbc47d473f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:28.947314 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-6947bf07-ebc9-4030-8334-71cbc47d473f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:28.948484 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-6947bf07-ebc9-4030-8334-71cbc47d473f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1738 microversion: 2.20 time: 0.216557 Aug 09 18:51:28.949044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 189/369] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:28 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1738 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:51:29.746797 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-9532eca9-6eff-4d1c-b4b3-46157bf91559 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:29.747429 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-9532eca9-6eff-4d1c-b4b3-46157bf91559 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:29.756011 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9532eca9-6eff-4d1c-b4b3-46157bf91559 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:29.756593 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9532eca9-6eff-4d1c-b4b3-46157bf91559 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:29.757349 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9532eca9-6eff-4d1c-b4b3-46157bf91559 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:29.758476 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9532eca9-6eff-4d1c-b4b3-46157bf91559 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:29.759012 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9532eca9-6eff-4d1c-b4b3-46157bf91559 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:29.759447 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9532eca9-6eff-4d1c-b4b3-46157bf91559 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:29.900011 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-9532eca9-6eff-4d1c-b4b3-46157bf91559 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:29.908905 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-9532eca9-6eff-4d1c-b4b3-46157bf91559 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1517 microversion: 2.1 time: 0.165885 Aug 09 18:51:29.909488 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 181/370] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:29 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:29.972806 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-1e69ca5f-5378-40f4-a73a-2298628df1cd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:29.973554 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-1e69ca5f-5378-40f4-a73a-2298628df1cd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:29.980438 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1e69ca5f-5378-40f4-a73a-2298628df1cd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:29.980914 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1e69ca5f-5378-40f4-a73a-2298628df1cd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:29.981336 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1e69ca5f-5378-40f4-a73a-2298628df1cd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:29.982051 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1e69ca5f-5378-40f4-a73a-2298628df1cd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:29.982495 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1e69ca5f-5378-40f4-a73a-2298628df1cd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:29.983094 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1e69ca5f-5378-40f4-a73a-2298628df1cd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:30.118164 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1e69ca5f-5378-40f4-a73a-2298628df1cd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:30.126316 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1e69ca5f-5378-40f4-a73a-2298628df1cd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:30.127802 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1e69ca5f-5378-40f4-a73a-2298628df1cd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:30.128945 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-1e69ca5f-5378-40f4-a73a-2298628df1cd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1738 microversion: 2.20 time: 0.160149 Aug 09 18:51:30.129496 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 190/371] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:29 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:51:31.156609 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-71d9b10a-bf8b-4b96-a5cb-73aef8c1ca57 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:31.157209 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-71d9b10a-bf8b-4b96-a5cb-73aef8c1ca57 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:31.164017 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-71d9b10a-bf8b-4b96-a5cb-73aef8c1ca57 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:31.164497 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-71d9b10a-bf8b-4b96-a5cb-73aef8c1ca57 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:31.164929 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-71d9b10a-bf8b-4b96-a5cb-73aef8c1ca57 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:31.165647 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-71d9b10a-bf8b-4b96-a5cb-73aef8c1ca57 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:31.166096 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-71d9b10a-bf8b-4b96-a5cb-73aef8c1ca57 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:31.166515 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-71d9b10a-bf8b-4b96-a5cb-73aef8c1ca57 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:31.305223 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-71d9b10a-bf8b-4b96-a5cb-73aef8c1ca57 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:31.315641 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-71d9b10a-bf8b-4b96-a5cb-73aef8c1ca57 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:31.317133 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-71d9b10a-bf8b-4b96-a5cb-73aef8c1ca57 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:31.318454 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-71d9b10a-bf8b-4b96-a5cb-73aef8c1ca57 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1720 microversion: 2.20 time: 0.166625 Aug 09 18:51:31.319034 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 182/372] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:31 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:51:31.666328 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d4bb7b6d-1db6-4920-a919-c6edcda25aca tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Action: 'create', calling method: .version_select at 0x7f8d6986c040>, body: {"keypair": {"name": "tempest-keypair-1410633890", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH9EsIlioIf7n2w/KpHSj1U973uf2jzAw+EJjIBnlvf696NDpVHLKxlc2Xv7zCloPg1/1fNsQexGRp8oiWmz+VmdDiNfAlKD5dRh60W0e1k5cPK1cX8FQ4n6l46PrS1eIg=="}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:51:31.683371 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-d4bb7b6d-1db6-4920-a919-c6edcda25aca tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Getting quotas for project d3c7915d78334e95a41a32f0f3b5b084. Resources: {'key_pairs'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:51:31.687860 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-d4bb7b6d-1db6-4920-a919-c6edcda25aca tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Getting quotas for user 04da0f4276d6457c889ecb3006842e9c and project d3c7915d78334e95a41a32f0f3b5b084. Resources: {'key_pairs'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:51:31.815948 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-d4bb7b6d-1db6-4920-a919-c6edcda25aca tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.153462 Aug 09 18:51:31.816561 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 191/373] 10.222.0.57 () {60 vars in 1159 bytes} [Tue Aug 9 18:51:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:51:32.343625 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-09e2541e-ce95-4092-bce1-650f378e5615 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:32.344842 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-09e2541e-ce95-4092-bce1-650f378e5615 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:32.352355 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-09e2541e-ce95-4092-bce1-650f378e5615 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:32.353647 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-09e2541e-ce95-4092-bce1-650f378e5615 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:32.354733 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-09e2541e-ce95-4092-bce1-650f378e5615 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:32.356244 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-09e2541e-ce95-4092-bce1-650f378e5615 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:32.357294 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-09e2541e-ce95-4092-bce1-650f378e5615 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:32.358386 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-09e2541e-ce95-4092-bce1-650f378e5615 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:32.502981 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-09e2541e-ce95-4092-bce1-650f378e5615 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:32.509296 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-09e2541e-ce95-4092-bce1-650f378e5615 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:32.510838 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-09e2541e-ce95-4092-bce1-650f378e5615 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:32.511999 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-09e2541e-ce95-4092-bce1-650f378e5615 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1720 microversion: 2.20 time: 0.172990 Aug 09 18:51:32.512542 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 183/374] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:32 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:51:33.537463 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-1975abf0-3b8e-44fe-9584-048a79614ac2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:33.538237 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-1975abf0-3b8e-44fe-9584-048a79614ac2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:33.545656 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1975abf0-3b8e-44fe-9584-048a79614ac2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:33.546346 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1975abf0-3b8e-44fe-9584-048a79614ac2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:33.546778 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1975abf0-3b8e-44fe-9584-048a79614ac2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:33.547477 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1975abf0-3b8e-44fe-9584-048a79614ac2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:33.547929 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1975abf0-3b8e-44fe-9584-048a79614ac2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:33.548395 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1975abf0-3b8e-44fe-9584-048a79614ac2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:33.742019 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1975abf0-3b8e-44fe-9584-048a79614ac2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:33.751706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1975abf0-3b8e-44fe-9584-048a79614ac2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:33.753382 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1975abf0-3b8e-44fe-9584-048a79614ac2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:33.754784 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-1975abf0-3b8e-44fe-9584-048a79614ac2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1723 microversion: 2.20 time: 0.221748 Aug 09 18:51:33.755646 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 192/375] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:33 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:51:33.781209 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-262881f1-ac8f-4004-a6e2-7d254c470594 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3590a6e4-9add-4d68-9e7e-b475a80c97df"}} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:51:33.783962 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-262881f1-ac8f-4004-a6e2-7d254c470594 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:33.791830 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-262881f1-ac8f-4004-a6e2-7d254c470594 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:33.792337 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-262881f1-ac8f-4004-a6e2-7d254c470594 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:33.792924 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-262881f1-ac8f-4004-a6e2-7d254c470594 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:33.793699 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-262881f1-ac8f-4004-a6e2-7d254c470594 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:33.794329 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-262881f1-ac8f-4004-a6e2-7d254c470594 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:33.794456 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-d9ad05de-ba15-4421-b7f6-7684c5e861da req-168fc0c7-adc8-4f50-9e05-084cfb9d8b27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22aac118-db08-4aca-a5e7-3f2cad5e49fd", "name": "network-vif-unplugged", "status": "completed", "tag": "7a0b7c9e-84bf-4317-b8ea-f03780b0d3b2"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:51:33.795060 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-262881f1-ac8f-4004-a6e2-7d254c470594 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:33.799312 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell1:SELECT=100 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:51:33.808572 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-d9ad05de-ba15-4421-b7f6-7684c5e861da req-168fc0c7-adc8-4f50-9e05-084cfb9d8b27 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:33.809123 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-d9ad05de-ba15-4421-b7f6-7684c5e861da req-168fc0c7-adc8-4f50-9e05-084cfb9d8b27 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:33.809665 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-d9ad05de-ba15-4421-b7f6-7684c5e861da req-168fc0c7-adc8-4f50-9e05-084cfb9d8b27 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:33.837593 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.compute.server_external_events [req-d9ad05de-ba15-4421-b7f6-7684c5e861da req-168fc0c7-adc8-4f50-9e05-084cfb9d8b27 service nova] Unable to find a host for instance 22aac118-db08-4aca-a5e7-3f2cad5e49fd. Dropping event network-vif-unplugged {{(pid=124725) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 09 18:51:33.838911 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-d9ad05de-ba15-4421-b7f6-7684c5e861da req-168fc0c7-adc8-4f50-9e05-084cfb9d8b27 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.048762 Aug 09 18:51:33.839699 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 193/376] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 50 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 09 18:51:34.414539 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-ea857334-031c-43b7-a223-d286baab9ce2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-594035824", "imageRef": "124dd477-ccfa-4be3-9973-6b1f33b47df8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2ec0f66c-7c91-4571-a05d-131085748c82"}], "security_groups": [{"name": "tempest-securitygroup--1559177440"}], "key_name": "tempest-keypair-1410633890", "user_data": "}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:51:34.518190 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.network.neutron [None req-ea857334-031c-43b7-a223-d286baab9ce2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] validate_networks() for [('2ec0f66c-7c91-4571-a05d-131085748c82', None, None, None, None, None)] {{(pid=124725) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:51:34.901773 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-ea857334-031c-43b7-a223-d286baab9ce2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Flavor limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:51:34.902366 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-ea857334-031c-43b7-a223-d286baab9ce2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Image limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:51:34.902713 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-ea857334-031c-43b7-a223-d286baab9ce2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Flavor pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:51:34.903115 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-ea857334-031c-43b7-a223-d286baab9ce2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Image pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:51:34.903580 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-ea857334-031c-43b7-a223-d286baab9ce2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:51:34.912902 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ea857334-031c-43b7-a223-d286baab9ce2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:34.913371 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ea857334-031c-43b7-a223-d286baab9ce2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:34.913824 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ea857334-031c-43b7-a223-d286baab9ce2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:34.914539 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ea857334-031c-43b7-a223-d286baab9ce2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:34.914987 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ea857334-031c-43b7-a223-d286baab9ce2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:34.915401 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ea857334-031c-43b7-a223-d286baab9ce2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:34.934651 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-ea857334-031c-43b7-a223-d286baab9ce2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Getting quotas for project d3c7915d78334e95a41a32f0f3b5b084. Resources: {'cores', 'ram', 'instances'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:51:34.940902 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-ea857334-031c-43b7-a223-d286baab9ce2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Getting quotas for user 04da0f4276d6457c889ecb3006842e9c and project d3c7915d78334e95a41a32f0f3b5b084. Resources: {'cores', 'ram', 'instances'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:51:34.953879 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-ea857334-031c-43b7-a223-d286baab9ce2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Going to run 1 instances... {{(pid=124725) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:51:34.956214 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-ea857334-031c-43b7-a223-d286baab9ce2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='124dd477-ccfa-4be3-9973-6b1f33b47df8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:51:35.048151 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-262881f1-ac8f-4004-a6e2-7d254c470594 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "POST /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.271707 Aug 09 18:51:35.049138 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 184/377] 10.222.0.57 () {62 vars in 1364 bytes} [Tue Aug 9 18:51:33 2022] POST /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd/os-volume_attachments => generated 188 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:51:35.119825 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-ea857334-031c-43b7-a223-d286baab9ce2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.709557 Aug 09 18:51:35.120728 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 194/378] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 9 18:51:34 2022] POST /compute/v2.1/servers => generated 409 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 18:51:35.133039 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-68204bcf-b9a7-4ffb-82bf-c57b530e8a24 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:35.134096 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-68204bcf-b9a7-4ffb-82bf-c57b530e8a24 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:35.210129 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-68204bcf-b9a7-4ffb-82bf-c57b530e8a24 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:35.218886 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-68204bcf-b9a7-4ffb-82bf-c57b530e8a24 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2" status: 200 len: 1245 microversion: 2.1 time: 0.090641 Aug 09 18:51:35.219585 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 185/379] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:35 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2 => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:35.355324 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-93a3d2eb-e052-4713-8b6b-5d12115ade60 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:51:35.355919 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-93a3d2eb-e052-4713-8b6b-5d12115ade60 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:35.362588 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-93a3d2eb-e052-4713-8b6b-5d12115ade60 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:35.363218 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-93a3d2eb-e052-4713-8b6b-5d12115ade60 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:35.363655 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-93a3d2eb-e052-4713-8b6b-5d12115ade60 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:35.364345 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-93a3d2eb-e052-4713-8b6b-5d12115ade60 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:35.364799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-93a3d2eb-e052-4713-8b6b-5d12115ade60 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:35.365228 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-93a3d2eb-e052-4713-8b6b-5d12115ade60 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:35.407889 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-93a3d2eb-e052-4713-8b6b-5d12115ade60 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124725) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 09 18:51:35.718583 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-93a3d2eb-e052-4713-8b6b-5d12115ade60 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "POST /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd/action" status: 202 len: 0 microversion: 2.20 time: 0.367269 Aug 09 18:51:35.719519 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 195/380] 10.222.0.57 () {62 vars in 1319 bytes} [Tue Aug 9 18:51:35 2022] POST /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:51:35.728176 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-02b2c5f2-7dec-46a1-ab5c-15b4fd1d2e31 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:35.729010 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-02b2c5f2-7dec-46a1-ab5c-15b4fd1d2e31 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:35.735390 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-02b2c5f2-7dec-46a1-ab5c-15b4fd1d2e31 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:35.735876 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-02b2c5f2-7dec-46a1-ab5c-15b4fd1d2e31 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:35.736311 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-02b2c5f2-7dec-46a1-ab5c-15b4fd1d2e31 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:35.737016 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-02b2c5f2-7dec-46a1-ab5c-15b4fd1d2e31 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:35.737503 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-02b2c5f2-7dec-46a1-ab5c-15b4fd1d2e31 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:35.737926 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-02b2c5f2-7dec-46a1-ab5c-15b4fd1d2e31 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:35.880103 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-02b2c5f2-7dec-46a1-ab5c-15b4fd1d2e31 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:35.902849 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-02b2c5f2-7dec-46a1-ab5c-15b4fd1d2e31 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:35.904420 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-02b2c5f2-7dec-46a1-ab5c-15b4fd1d2e31 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:35.905669 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-02b2c5f2-7dec-46a1-ab5c-15b4fd1d2e31 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1749 microversion: 2.20 time: 0.181550 Aug 09 18:51:35.917137 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 186/381] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:35 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1749 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:51:36.240134 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-09a47031-e917-4e4f-ae6c-db2566db6045 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:36.240980 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-09a47031-e917-4e4f-ae6c-db2566db6045 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:36.247112 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-09a47031-e917-4e4f-ae6c-db2566db6045 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:36.247606 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-09a47031-e917-4e4f-ae6c-db2566db6045 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:36.248043 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-09a47031-e917-4e4f-ae6c-db2566db6045 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:36.248742 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-09a47031-e917-4e4f-ae6c-db2566db6045 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:36.249852 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-09a47031-e917-4e4f-ae6c-db2566db6045 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:36.250296 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-09a47031-e917-4e4f-ae6c-db2566db6045 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:36.320486 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-09a47031-e917-4e4f-ae6c-db2566db6045 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:36.328157 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-09a47031-e917-4e4f-ae6c-db2566db6045 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2" status: 200 len: 1249 microversion: 2.1 time: 0.091898 Aug 09 18:51:36.328663 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 196/382] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:36 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2 => generated 1249 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:36.928778 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-7c8a014e-475e-40d4-95c4-896d6a65f7f2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:36.929382 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-7c8a014e-475e-40d4-95c4-896d6a65f7f2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:36.936159 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7c8a014e-475e-40d4-95c4-896d6a65f7f2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:36.936676 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7c8a014e-475e-40d4-95c4-896d6a65f7f2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:36.937273 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7c8a014e-475e-40d4-95c4-896d6a65f7f2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:36.937938 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7c8a014e-475e-40d4-95c4-896d6a65f7f2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:36.943004 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7c8a014e-475e-40d4-95c4-896d6a65f7f2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:36.943004 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7c8a014e-475e-40d4-95c4-896d6a65f7f2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:37.083847 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-7c8a014e-475e-40d4-95c4-896d6a65f7f2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:37.094054 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-7c8a014e-475e-40d4-95c4-896d6a65f7f2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:37.095823 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-7c8a014e-475e-40d4-95c4-896d6a65f7f2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:37.097108 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-7c8a014e-475e-40d4-95c4-896d6a65f7f2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1749 microversion: 2.20 time: 0.172323 Aug 09 18:51:37.097704 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 187/383] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:36 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1749 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:51:37.348406 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-0428392a-f28b-4cdc-8062-99eab2c3fd30 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:37.349680 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-0428392a-f28b-4cdc-8062-99eab2c3fd30 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:37.353597 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:51:37.357462 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0428392a-f28b-4cdc-8062-99eab2c3fd30 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:37.358234 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0428392a-f28b-4cdc-8062-99eab2c3fd30 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:37.358848 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0428392a-f28b-4cdc-8062-99eab2c3fd30 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:37.359726 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0428392a-f28b-4cdc-8062-99eab2c3fd30 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:37.360340 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0428392a-f28b-4cdc-8062-99eab2c3fd30 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:37.360770 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0428392a-f28b-4cdc-8062-99eab2c3fd30 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:37.438292 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-0428392a-f28b-4cdc-8062-99eab2c3fd30 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:37.449424 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-0428392a-f28b-4cdc-8062-99eab2c3fd30 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2" status: 200 len: 1305 microversion: 2.1 time: 0.104843 Aug 09 18:51:37.450043 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 197/384] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:37 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2 => generated 1305 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:38.120097 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-0f42f5a5-5b28-4756-a077-adc67ab98de6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:38.120705 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-0f42f5a5-5b28-4756-a077-adc67ab98de6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:38.127278 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0f42f5a5-5b28-4756-a077-adc67ab98de6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:38.129456 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0f42f5a5-5b28-4756-a077-adc67ab98de6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:38.129456 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0f42f5a5-5b28-4756-a077-adc67ab98de6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:38.129456 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0f42f5a5-5b28-4756-a077-adc67ab98de6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:38.129456 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0f42f5a5-5b28-4756-a077-adc67ab98de6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:38.129982 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0f42f5a5-5b28-4756-a077-adc67ab98de6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:38.281139 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-0f42f5a5-5b28-4756-a077-adc67ab98de6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:38.290779 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-0f42f5a5-5b28-4756-a077-adc67ab98de6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:38.292394 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-0f42f5a5-5b28-4756-a077-adc67ab98de6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:38.293789 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-0f42f5a5-5b28-4756-a077-adc67ab98de6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1751 microversion: 2.20 time: 0.177643 Aug 09 18:51:38.294870 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 188/385] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:38 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1751 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:51:38.472769 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-657ff070-4308-4d23-8cce-ca9284287f63 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:38.475742 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-657ff070-4308-4d23-8cce-ca9284287f63 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:38.480810 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-657ff070-4308-4d23-8cce-ca9284287f63 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:38.481452 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-657ff070-4308-4d23-8cce-ca9284287f63 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:38.482445 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-657ff070-4308-4d23-8cce-ca9284287f63 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:38.482741 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-657ff070-4308-4d23-8cce-ca9284287f63 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:38.483251 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-657ff070-4308-4d23-8cce-ca9284287f63 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:38.483782 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-657ff070-4308-4d23-8cce-ca9284287f63 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:38.727359 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-657ff070-4308-4d23-8cce-ca9284287f63 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:38.735029 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-657ff070-4308-4d23-8cce-ca9284287f63 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2" status: 200 len: 1371 microversion: 2.1 time: 0.267360 Aug 09 18:51:38.748419 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 198/386] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:38 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2 => generated 1371 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:39.294998 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-3a83e6e9-afd9-4cd7-80a8-6aca5f4e1991 req-053f3326-66e3-47ba-a29d-30c18b2dbed7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e15bc2b4-4702-4ee5-9483-87db30954da2", "tag": "6d0d654f-2f8f-4f17-bf93-aa249db5c6d8"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:51:39.306829 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-3a83e6e9-afd9-4cd7-80a8-6aca5f4e1991 req-053f3326-66e3-47ba-a29d-30c18b2dbed7 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:39.307579 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-3a83e6e9-afd9-4cd7-80a8-6aca5f4e1991 req-053f3326-66e3-47ba-a29d-30c18b2dbed7 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:39.308005 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-3a83e6e9-afd9-4cd7-80a8-6aca5f4e1991 req-053f3326-66e3-47ba-a29d-30c18b2dbed7 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:39.320740 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-3a83e6e9-afd9-4cd7-80a8-6aca5f4e1991 req-053f3326-66e3-47ba-a29d-30c18b2dbed7 service nova] Creating event network-changed:6d0d654f-2f8f-4f17-bf93-aa249db5c6d8 for instance e15bc2b4-4702-4ee5-9483-87db30954da2 on hv-cinder-82660 Aug 09 18:51:39.320956 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-dbb9ebc7-be82-48c8-aad0-6e9faae5f9dd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:39.322063 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-dbb9ebc7-be82-48c8-aad0-6e9faae5f9dd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:39.326781 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-3a83e6e9-afd9-4cd7-80a8-6aca5f4e1991 req-053f3326-66e3-47ba-a29d-30c18b2dbed7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037671 Aug 09 18:51:39.328149 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 189/387] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:51:39.333478 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dbb9ebc7-be82-48c8-aad0-6e9faae5f9dd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:39.335046 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dbb9ebc7-be82-48c8-aad0-6e9faae5f9dd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:39.335947 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dbb9ebc7-be82-48c8-aad0-6e9faae5f9dd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:39.337256 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dbb9ebc7-be82-48c8-aad0-6e9faae5f9dd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:39.337996 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dbb9ebc7-be82-48c8-aad0-6e9faae5f9dd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:39.338917 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dbb9ebc7-be82-48c8-aad0-6e9faae5f9dd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:39.756600 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-73ab4ba6-e4aa-4072-b3ac-bfb54074e8ea tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:39.757302 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-73ab4ba6-e4aa-4072-b3ac-bfb54074e8ea tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:39.760622 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-dbb9ebc7-be82-48c8-aad0-6e9faae5f9dd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:39.764152 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-73ab4ba6-e4aa-4072-b3ac-bfb54074e8ea tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:39.764294 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-73ab4ba6-e4aa-4072-b3ac-bfb54074e8ea tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:39.764649 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-73ab4ba6-e4aa-4072-b3ac-bfb54074e8ea tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:39.765364 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-73ab4ba6-e4aa-4072-b3ac-bfb54074e8ea tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:39.765847 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-73ab4ba6-e4aa-4072-b3ac-bfb54074e8ea tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:39.766271 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-73ab4ba6-e4aa-4072-b3ac-bfb54074e8ea tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:39.770025 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-dbb9ebc7-be82-48c8-aad0-6e9faae5f9dd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:39.771515 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-dbb9ebc7-be82-48c8-aad0-6e9faae5f9dd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:39.773151 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-dbb9ebc7-be82-48c8-aad0-6e9faae5f9dd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1807 microversion: 2.20 time: 0.458658 Aug 09 18:51:39.773935 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 199/388] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:39 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1807 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:51:40.025225 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-73ab4ba6-e4aa-4072-b3ac-bfb54074e8ea tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:40.036293 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-73ab4ba6-e4aa-4072-b3ac-bfb54074e8ea tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2" status: 200 len: 1371 microversion: 2.1 time: 0.283411 Aug 09 18:51:40.037258 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 190/389] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:39 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2 => generated 1371 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:51:40.799693 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-6df48380-c966-4d02-ab5e-0faab86e85e5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:40.799693 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-6df48380-c966-4d02-ab5e-0faab86e85e5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:40.806269 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6df48380-c966-4d02-ab5e-0faab86e85e5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:40.808934 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6df48380-c966-4d02-ab5e-0faab86e85e5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:40.808934 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6df48380-c966-4d02-ab5e-0faab86e85e5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:40.808934 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6df48380-c966-4d02-ab5e-0faab86e85e5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:40.808934 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6df48380-c966-4d02-ab5e-0faab86e85e5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:40.809272 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6df48380-c966-4d02-ab5e-0faab86e85e5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:40.937691 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-6df48380-c966-4d02-ab5e-0faab86e85e5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:40.946025 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-6df48380-c966-4d02-ab5e-0faab86e85e5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:40.947502 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-6df48380-c966-4d02-ab5e-0faab86e85e5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:40.948637 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-6df48380-c966-4d02-ab5e-0faab86e85e5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1807 microversion: 2.20 time: 0.156212 Aug 09 18:51:40.949182 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 200/390] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:40 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:51:41.057599 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-2196ce39-9863-435f-be4a-434f7869186e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:41.058216 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-2196ce39-9863-435f-be4a-434f7869186e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:41.066024 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2196ce39-9863-435f-be4a-434f7869186e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:41.066507 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2196ce39-9863-435f-be4a-434f7869186e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:41.066939 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2196ce39-9863-435f-be4a-434f7869186e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:41.067629 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2196ce39-9863-435f-be4a-434f7869186e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:41.068087 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2196ce39-9863-435f-be4a-434f7869186e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:41.068511 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2196ce39-9863-435f-be4a-434f7869186e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:41.207754 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-2196ce39-9863-435f-be4a-434f7869186e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:41.215277 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-2196ce39-9863-435f-be4a-434f7869186e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2" status: 200 len: 1371 microversion: 2.1 time: 0.161513 Aug 09 18:51:41.215841 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 191/391] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:41 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:41.972064 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-13a9cdae-3742-47be-bfe2-14c05ead82a2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:41.972627 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-13a9cdae-3742-47be-bfe2-14c05ead82a2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:41.979120 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-13a9cdae-3742-47be-bfe2-14c05ead82a2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:41.979613 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-13a9cdae-3742-47be-bfe2-14c05ead82a2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:41.980048 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-13a9cdae-3742-47be-bfe2-14c05ead82a2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:41.980753 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-13a9cdae-3742-47be-bfe2-14c05ead82a2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:41.981205 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-13a9cdae-3742-47be-bfe2-14c05ead82a2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:41.981691 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-13a9cdae-3742-47be-bfe2-14c05ead82a2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:42.112734 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-13a9cdae-3742-47be-bfe2-14c05ead82a2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:42.121253 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-13a9cdae-3742-47be-bfe2-14c05ead82a2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:42.122805 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-13a9cdae-3742-47be-bfe2-14c05ead82a2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:42.123985 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-13a9cdae-3742-47be-bfe2-14c05ead82a2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1807 microversion: 2.20 time: 0.155873 Aug 09 18:51:42.130687 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 201/392] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:41 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:51:42.242908 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-e02ec354-361e-4c2c-82d1-dc26f9df78ff tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:42.245648 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-e02ec354-361e-4c2c-82d1-dc26f9df78ff tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:42.257089 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e02ec354-361e-4c2c-82d1-dc26f9df78ff tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:42.258290 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e02ec354-361e-4c2c-82d1-dc26f9df78ff tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:42.259058 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e02ec354-361e-4c2c-82d1-dc26f9df78ff tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:42.260369 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e02ec354-361e-4c2c-82d1-dc26f9df78ff tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:42.262968 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e02ec354-361e-4c2c-82d1-dc26f9df78ff tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:42.263617 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e02ec354-361e-4c2c-82d1-dc26f9df78ff tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:42.430254 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-e02ec354-361e-4c2c-82d1-dc26f9df78ff tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:42.447005 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-e02ec354-361e-4c2c-82d1-dc26f9df78ff tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2" status: 200 len: 1371 microversion: 2.1 time: 0.213910 Aug 09 18:51:42.469726 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 192/393] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:42 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2 => generated 1371 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:43.147856 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b6183b79-4fab-4cf4-b276-cf13454f9b6d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:43.148468 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-b6183b79-4fab-4cf4-b276-cf13454f9b6d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:43.155069 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b6183b79-4fab-4cf4-b276-cf13454f9b6d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:43.155567 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b6183b79-4fab-4cf4-b276-cf13454f9b6d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:43.155994 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b6183b79-4fab-4cf4-b276-cf13454f9b6d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:43.157307 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b6183b79-4fab-4cf4-b276-cf13454f9b6d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:43.157791 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b6183b79-4fab-4cf4-b276-cf13454f9b6d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:43.158399 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b6183b79-4fab-4cf4-b276-cf13454f9b6d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:43.177293 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:51:43.304395 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-b6183b79-4fab-4cf4-b276-cf13454f9b6d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:43.314082 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-b6183b79-4fab-4cf4-b276-cf13454f9b6d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:43.315595 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-b6183b79-4fab-4cf4-b276-cf13454f9b6d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:43.316767 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-b6183b79-4fab-4cf4-b276-cf13454f9b6d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1807 microversion: 2.20 time: 0.172917 Aug 09 18:51:43.317333 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 202/394] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:43 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:51:43.482997 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-a89601e5-b096-4b04-806c-c54f9138fb04 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:43.483528 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-a89601e5-b096-4b04-806c-c54f9138fb04 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:43.489730 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a89601e5-b096-4b04-806c-c54f9138fb04 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:43.490207 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a89601e5-b096-4b04-806c-c54f9138fb04 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:43.490634 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a89601e5-b096-4b04-806c-c54f9138fb04 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:43.491310 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a89601e5-b096-4b04-806c-c54f9138fb04 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:43.491752 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a89601e5-b096-4b04-806c-c54f9138fb04 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:43.492164 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a89601e5-b096-4b04-806c-c54f9138fb04 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:43.631344 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-a89601e5-b096-4b04-806c-c54f9138fb04 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:43.639085 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-a89601e5-b096-4b04-806c-c54f9138fb04 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2" status: 200 len: 1371 microversion: 2.1 time: 0.160175 Aug 09 18:51:43.639661 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 193/395] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:43 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:43.926726 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-438033de-0ec2-497e-8c17-00e1986423d0 req-e52c78dc-f0f1-4064-a206-c90ecc5fe4d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e15bc2b4-4702-4ee5-9483-87db30954da2", "name": "network-vif-plugged", "status": "completed", "tag": "6d0d654f-2f8f-4f17-bf93-aa249db5c6d8"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:51:43.936627 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-438033de-0ec2-497e-8c17-00e1986423d0 req-e52c78dc-f0f1-4064-a206-c90ecc5fe4d1 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:43.936885 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-438033de-0ec2-497e-8c17-00e1986423d0 req-e52c78dc-f0f1-4064-a206-c90ecc5fe4d1 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:43.938041 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-438033de-0ec2-497e-8c17-00e1986423d0 req-e52c78dc-f0f1-4064-a206-c90ecc5fe4d1 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:43.952063 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-438033de-0ec2-497e-8c17-00e1986423d0 req-e52c78dc-f0f1-4064-a206-c90ecc5fe4d1 service nova] Creating event network-vif-plugged:6d0d654f-2f8f-4f17-bf93-aa249db5c6d8 for instance e15bc2b4-4702-4ee5-9483-87db30954da2 on hv-cinder-82660 Aug 09 18:51:43.958331 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-438033de-0ec2-497e-8c17-00e1986423d0 req-e52c78dc-f0f1-4064-a206-c90ecc5fe4d1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036325 Aug 09 18:51:43.958942 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 203/396] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:51:44.340251 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-26dd1024-c8e4-4b82-b42c-1e43e0a24a74 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:44.340908 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-26dd1024-c8e4-4b82-b42c-1e43e0a24a74 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:44.347707 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-26dd1024-c8e4-4b82-b42c-1e43e0a24a74 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:44.348189 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-26dd1024-c8e4-4b82-b42c-1e43e0a24a74 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:44.348616 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-26dd1024-c8e4-4b82-b42c-1e43e0a24a74 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:44.349302 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-26dd1024-c8e4-4b82-b42c-1e43e0a24a74 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:44.349793 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-26dd1024-c8e4-4b82-b42c-1e43e0a24a74 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:44.350215 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-26dd1024-c8e4-4b82-b42c-1e43e0a24a74 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:44.488475 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-26dd1024-c8e4-4b82-b42c-1e43e0a24a74 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:44.496784 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-26dd1024-c8e4-4b82-b42c-1e43e0a24a74 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:44.498303 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-26dd1024-c8e4-4b82-b42c-1e43e0a24a74 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:44.499445 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-26dd1024-c8e4-4b82-b42c-1e43e0a24a74 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1807 microversion: 2.20 time: 0.163210 Aug 09 18:51:44.499999 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 194/397] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:44 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:51:44.661725 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-bd859cdf-5b06-4e12-a7a6-5b1728b4af44 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:44.662430 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-bd859cdf-5b06-4e12-a7a6-5b1728b4af44 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:44.668532 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bd859cdf-5b06-4e12-a7a6-5b1728b4af44 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:44.669017 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bd859cdf-5b06-4e12-a7a6-5b1728b4af44 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:44.669447 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bd859cdf-5b06-4e12-a7a6-5b1728b4af44 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:44.670162 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bd859cdf-5b06-4e12-a7a6-5b1728b4af44 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:44.670610 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bd859cdf-5b06-4e12-a7a6-5b1728b4af44 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:44.671031 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bd859cdf-5b06-4e12-a7a6-5b1728b4af44 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:44.803355 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-bd859cdf-5b06-4e12-a7a6-5b1728b4af44 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:44.810954 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-bd859cdf-5b06-4e12-a7a6-5b1728b4af44 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2" status: 200 len: 1371 microversion: 2.1 time: 0.154628 Aug 09 18:51:44.811532 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 204/398] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:44 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:45.523144 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-e46b460e-cac4-433b-a430-a1ff2fcaf3df tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:45.523767 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-e46b460e-cac4-433b-a430-a1ff2fcaf3df tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:45.525785 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell0:SELECT=2 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:51:45.531024 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e46b460e-cac4-433b-a430-a1ff2fcaf3df tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:45.532042 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e46b460e-cac4-433b-a430-a1ff2fcaf3df tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:45.532478 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e46b460e-cac4-433b-a430-a1ff2fcaf3df tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:45.533172 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e46b460e-cac4-433b-a430-a1ff2fcaf3df tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:45.533650 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e46b460e-cac4-433b-a430-a1ff2fcaf3df tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:45.534074 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e46b460e-cac4-433b-a430-a1ff2fcaf3df tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:45.674737 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-e46b460e-cac4-433b-a430-a1ff2fcaf3df tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:45.683435 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-e46b460e-cac4-433b-a430-a1ff2fcaf3df tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:45.684947 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-e46b460e-cac4-433b-a430-a1ff2fcaf3df tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:45.686144 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-e46b460e-cac4-433b-a430-a1ff2fcaf3df tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1807 microversion: 2.20 time: 0.166995 Aug 09 18:51:45.686704 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 195/399] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:45 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:51:45.833266 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-9fd0f1da-f936-46ea-b9e3-66e3dd7ee0a0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:45.834647 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-9fd0f1da-f936-46ea-b9e3-66e3dd7ee0a0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:45.837991 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=2 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:51:45.840740 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=10 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:51:45.842593 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9fd0f1da-f936-46ea-b9e3-66e3dd7ee0a0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:45.843142 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9fd0f1da-f936-46ea-b9e3-66e3dd7ee0a0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:45.843659 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9fd0f1da-f936-46ea-b9e3-66e3dd7ee0a0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:45.845339 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9fd0f1da-f936-46ea-b9e3-66e3dd7ee0a0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:45.845912 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9fd0f1da-f936-46ea-b9e3-66e3dd7ee0a0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:45.846540 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9fd0f1da-f936-46ea-b9e3-66e3dd7ee0a0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:45.995004 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-9fd0f1da-f936-46ea-b9e3-66e3dd7ee0a0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:46.004483 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-9fd0f1da-f936-46ea-b9e3-66e3dd7ee0a0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2" status: 200 len: 1371 microversion: 2.1 time: 0.175808 Aug 09 18:51:46.005063 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 205/400] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:45 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2 => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:46.709813 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-71e2ad95-bcfa-4c9f-b89b-e39df6119173 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:46.710577 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-71e2ad95-bcfa-4c9f-b89b-e39df6119173 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:46.717229 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-71e2ad95-bcfa-4c9f-b89b-e39df6119173 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:46.719375 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-71e2ad95-bcfa-4c9f-b89b-e39df6119173 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:46.719806 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-71e2ad95-bcfa-4c9f-b89b-e39df6119173 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:46.720575 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-71e2ad95-bcfa-4c9f-b89b-e39df6119173 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:46.721052 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-71e2ad95-bcfa-4c9f-b89b-e39df6119173 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:46.721478 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-71e2ad95-bcfa-4c9f-b89b-e39df6119173 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:46.860807 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-71e2ad95-bcfa-4c9f-b89b-e39df6119173 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:46.871848 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-71e2ad95-bcfa-4c9f-b89b-e39df6119173 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:46.873355 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-71e2ad95-bcfa-4c9f-b89b-e39df6119173 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:46.874574 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-71e2ad95-bcfa-4c9f-b89b-e39df6119173 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1807 microversion: 2.20 time: 0.169313 Aug 09 18:51:46.875537 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 196/401] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:46 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:51:47.031264 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b14a0eb1-1259-4343-8d26-43ace0b1a1e0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:47.035185 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-b14a0eb1-1259-4343-8d26-43ace0b1a1e0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:47.042236 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b14a0eb1-1259-4343-8d26-43ace0b1a1e0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:47.042793 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b14a0eb1-1259-4343-8d26-43ace0b1a1e0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:47.043241 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b14a0eb1-1259-4343-8d26-43ace0b1a1e0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:47.043958 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b14a0eb1-1259-4343-8d26-43ace0b1a1e0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:47.046635 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b14a0eb1-1259-4343-8d26-43ace0b1a1e0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:47.046635 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b14a0eb1-1259-4343-8d26-43ace0b1a1e0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:47.192616 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-b14a0eb1-1259-4343-8d26-43ace0b1a1e0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:47.204245 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-b14a0eb1-1259-4343-8d26-43ace0b1a1e0 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2" status: 200 len: 1371 microversion: 2.1 time: 0.181048 Aug 09 18:51:47.205107 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 206/402] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:47 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2 => generated 1371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:47.897883 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-52874db8-f0e4-4eec-b985-0b47ee1b2893 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:47.898499 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-52874db8-f0e4-4eec-b985-0b47ee1b2893 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:47.905124 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-52874db8-f0e4-4eec-b985-0b47ee1b2893 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:47.905649 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-52874db8-f0e4-4eec-b985-0b47ee1b2893 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:47.906086 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-52874db8-f0e4-4eec-b985-0b47ee1b2893 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:47.907307 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-52874db8-f0e4-4eec-b985-0b47ee1b2893 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:47.907760 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-52874db8-f0e4-4eec-b985-0b47ee1b2893 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:47.908184 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-52874db8-f0e4-4eec-b985-0b47ee1b2893 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:48.048967 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-52874db8-f0e4-4eec-b985-0b47ee1b2893 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:48.058604 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-52874db8-f0e4-4eec-b985-0b47ee1b2893 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:48.060212 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-52874db8-f0e4-4eec-b985-0b47ee1b2893 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:48.061389 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-52874db8-f0e4-4eec-b985-0b47ee1b2893 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1807 microversion: 2.20 time: 0.167524 Aug 09 18:51:48.061979 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 197/403] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:47 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:51:48.232347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c7c080b2-47cc-49c1-a3f8-86422f397394 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:48.232908 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-c7c080b2-47cc-49c1-a3f8-86422f397394 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:48.239426 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c7c080b2-47cc-49c1-a3f8-86422f397394 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:48.239911 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c7c080b2-47cc-49c1-a3f8-86422f397394 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:48.240347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c7c080b2-47cc-49c1-a3f8-86422f397394 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:48.241048 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c7c080b2-47cc-49c1-a3f8-86422f397394 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:48.241505 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c7c080b2-47cc-49c1-a3f8-86422f397394 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:48.241956 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c7c080b2-47cc-49c1-a3f8-86422f397394 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:48.380258 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-c7c080b2-47cc-49c1-a3f8-86422f397394 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:48.387798 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-c7c080b2-47cc-49c1-a3f8-86422f397394 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2" status: 200 len: 1371 microversion: 2.1 time: 0.159481 Aug 09 18:51:48.388360 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 207/404] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:48 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:49.084616 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-4e38873b-3265-4d30-b7ff-f8aad57155b9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:49.085322 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-4e38873b-3265-4d30-b7ff-f8aad57155b9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:49.091767 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4e38873b-3265-4d30-b7ff-f8aad57155b9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:49.092250 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4e38873b-3265-4d30-b7ff-f8aad57155b9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:49.092685 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4e38873b-3265-4d30-b7ff-f8aad57155b9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:49.093388 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4e38873b-3265-4d30-b7ff-f8aad57155b9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:49.093959 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4e38873b-3265-4d30-b7ff-f8aad57155b9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:49.094894 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4e38873b-3265-4d30-b7ff-f8aad57155b9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:49.240693 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-4e38873b-3265-4d30-b7ff-f8aad57155b9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:49.249887 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-4e38873b-3265-4d30-b7ff-f8aad57155b9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:49.252168 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-4e38873b-3265-4d30-b7ff-f8aad57155b9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:49.253648 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-4e38873b-3265-4d30-b7ff-f8aad57155b9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1807 microversion: 2.20 time: 0.173255 Aug 09 18:51:49.254216 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 198/405] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:49 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:51:49.408563 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-976d5e31-a7c8-4c42-b401-ee73b20b1044 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:49.409156 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-976d5e31-a7c8-4c42-b401-ee73b20b1044 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:49.415670 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-976d5e31-a7c8-4c42-b401-ee73b20b1044 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:49.416155 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-976d5e31-a7c8-4c42-b401-ee73b20b1044 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:49.416592 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-976d5e31-a7c8-4c42-b401-ee73b20b1044 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:49.417344 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-976d5e31-a7c8-4c42-b401-ee73b20b1044 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:49.417826 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-976d5e31-a7c8-4c42-b401-ee73b20b1044 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:49.418253 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-976d5e31-a7c8-4c42-b401-ee73b20b1044 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:49.559762 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-976d5e31-a7c8-4c42-b401-ee73b20b1044 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:49.568070 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-976d5e31-a7c8-4c42-b401-ee73b20b1044 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2" status: 200 len: 1371 microversion: 2.1 time: 0.163618 Aug 09 18:51:49.568641 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 208/406] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:49 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:50.281136 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-d66c78e6-1ffa-41ed-beb4-aaac628c55e9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:50.281136 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-d66c78e6-1ffa-41ed-beb4-aaac628c55e9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:50.286313 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d66c78e6-1ffa-41ed-beb4-aaac628c55e9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:50.286901 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d66c78e6-1ffa-41ed-beb4-aaac628c55e9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:50.287336 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d66c78e6-1ffa-41ed-beb4-aaac628c55e9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:50.288044 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d66c78e6-1ffa-41ed-beb4-aaac628c55e9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:50.288530 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d66c78e6-1ffa-41ed-beb4-aaac628c55e9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:50.288976 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d66c78e6-1ffa-41ed-beb4-aaac628c55e9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:50.440022 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-d66c78e6-1ffa-41ed-beb4-aaac628c55e9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:50.442888 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:51:50.450690 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-d66c78e6-1ffa-41ed-beb4-aaac628c55e9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:50.498267 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-d66c78e6-1ffa-41ed-beb4-aaac628c55e9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:50.498267 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-d66c78e6-1ffa-41ed-beb4-aaac628c55e9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1807 microversion: 2.20 time: 0.179760 Aug 09 18:51:50.498267 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 199/407] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:50 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:51:50.588986 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c96b8ae9-c203-4da7-97ca-934e4250e38e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:50.589724 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-c96b8ae9-c203-4da7-97ca-934e4250e38e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:50.601637 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c96b8ae9-c203-4da7-97ca-934e4250e38e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:50.602130 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c96b8ae9-c203-4da7-97ca-934e4250e38e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:50.602805 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c96b8ae9-c203-4da7-97ca-934e4250e38e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:50.603506 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c96b8ae9-c203-4da7-97ca-934e4250e38e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:50.603965 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c96b8ae9-c203-4da7-97ca-934e4250e38e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:50.604385 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c96b8ae9-c203-4da7-97ca-934e4250e38e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:50.686768 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-a7a81af5-21b1-4cfd-b1cb-77370f396522 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:50.687374 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-a7a81af5-21b1-4cfd-b1cb-77370f396522 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:50.700580 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a7a81af5-21b1-4cfd-b1cb-77370f396522 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:50.702595 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a7a81af5-21b1-4cfd-b1cb-77370f396522 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:50.703034 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a7a81af5-21b1-4cfd-b1cb-77370f396522 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:50.704475 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a7a81af5-21b1-4cfd-b1cb-77370f396522 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:50.704921 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a7a81af5-21b1-4cfd-b1cb-77370f396522 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:50.705341 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a7a81af5-21b1-4cfd-b1cb-77370f396522 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:50.731796 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-a7a81af5-21b1-4cfd-b1cb-77370f396522 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9/ips" status: 200 len: 151 microversion: 2.1 time: 0.049246 Aug 09 18:51:50.732658 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 200/408] 10.222.0.57 () {58 vars in 1248 bytes} [Tue Aug 9 18:51:50 2022] GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9/ips => generated 151 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:51:50.749512 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-c96b8ae9-c203-4da7-97ca-934e4250e38e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:50.759939 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-c96b8ae9-c203-4da7-97ca-934e4250e38e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2" status: 200 len: 1371 microversion: 2.1 time: 0.174876 Aug 09 18:51:50.760727 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 209/409] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:50 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2 => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:51.520218 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-e7ddf37b-ca3d-4f61-a879-91bb1362d7f1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:51.520871 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-e7ddf37b-ca3d-4f61-a879-91bb1362d7f1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:51.528530 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e7ddf37b-ca3d-4f61-a879-91bb1362d7f1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:51.529007 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e7ddf37b-ca3d-4f61-a879-91bb1362d7f1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:51.529537 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e7ddf37b-ca3d-4f61-a879-91bb1362d7f1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:51.530198 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e7ddf37b-ca3d-4f61-a879-91bb1362d7f1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:51.530648 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e7ddf37b-ca3d-4f61-a879-91bb1362d7f1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:51.531060 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e7ddf37b-ca3d-4f61-a879-91bb1362d7f1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:51.673725 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-e7ddf37b-ca3d-4f61-a879-91bb1362d7f1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:51.682423 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-e7ddf37b-ca3d-4f61-a879-91bb1362d7f1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:51.683895 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-e7ddf37b-ca3d-4f61-a879-91bb1362d7f1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:51.685076 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-e7ddf37b-ca3d-4f61-a879-91bb1362d7f1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1807 microversion: 2.20 time: 0.168973 Aug 09 18:51:51.685603 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 201/410] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:51 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:51:51.781450 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-623242bb-7b59-46e7-8cae-8442db7ff973 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:51.782156 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-623242bb-7b59-46e7-8cae-8442db7ff973 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:51.789088 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-623242bb-7b59-46e7-8cae-8442db7ff973 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:51.789595 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-623242bb-7b59-46e7-8cae-8442db7ff973 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:51.790033 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-623242bb-7b59-46e7-8cae-8442db7ff973 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:51.790735 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-623242bb-7b59-46e7-8cae-8442db7ff973 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:51.791184 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-623242bb-7b59-46e7-8cae-8442db7ff973 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:51.791602 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-623242bb-7b59-46e7-8cae-8442db7ff973 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:51.945354 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-623242bb-7b59-46e7-8cae-8442db7ff973 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:51.957464 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-623242bb-7b59-46e7-8cae-8442db7ff973 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2" status: 200 len: 1371 microversion: 2.1 time: 0.175983 Aug 09 18:51:51.958225 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 210/411] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:51 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2 => generated 1371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:52.506754 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-4f436130-e13d-4d35-bbd0-f5e3f4923cdc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2cf52a0-1953-4673-b81d-9aa9a817484e"}} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:51:52.509156 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-4f436130-e13d-4d35-bbd0-f5e3f4923cdc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:52.515345 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4f436130-e13d-4d35-bbd0-f5e3f4923cdc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:52.516355 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4f436130-e13d-4d35-bbd0-f5e3f4923cdc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:52.516792 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4f436130-e13d-4d35-bbd0-f5e3f4923cdc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:52.517602 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4f436130-e13d-4d35-bbd0-f5e3f4923cdc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:52.525553 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4f436130-e13d-4d35-bbd0-f5e3f4923cdc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:52.526296 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4f436130-e13d-4d35-bbd0-f5e3f4923cdc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:52.708924 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-beb35fba-1a7f-487f-9a17-5ea3d050d237 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:52.709445 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-beb35fba-1a7f-487f-9a17-5ea3d050d237 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:52.715624 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-beb35fba-1a7f-487f-9a17-5ea3d050d237 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:52.716100 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-beb35fba-1a7f-487f-9a17-5ea3d050d237 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:52.716531 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-beb35fba-1a7f-487f-9a17-5ea3d050d237 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:52.717210 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-beb35fba-1a7f-487f-9a17-5ea3d050d237 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:52.717690 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-beb35fba-1a7f-487f-9a17-5ea3d050d237 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:52.718108 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-beb35fba-1a7f-487f-9a17-5ea3d050d237 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:52.851709 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-beb35fba-1a7f-487f-9a17-5ea3d050d237 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:52.861306 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-beb35fba-1a7f-487f-9a17-5ea3d050d237 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:52.862837 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-beb35fba-1a7f-487f-9a17-5ea3d050d237 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:52.863996 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-beb35fba-1a7f-487f-9a17-5ea3d050d237 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1807 microversion: 2.20 time: 0.159136 Aug 09 18:51:52.864554 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 211/412] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:52 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:51:52.981233 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-7bad4418-389c-4eb7-b21c-985e247f1de9 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:52.981233 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-7bad4418-389c-4eb7-b21c-985e247f1de9 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:52.986960 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7bad4418-389c-4eb7-b21c-985e247f1de9 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:52.987556 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7bad4418-389c-4eb7-b21c-985e247f1de9 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:52.987992 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7bad4418-389c-4eb7-b21c-985e247f1de9 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:52.988725 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7bad4418-389c-4eb7-b21c-985e247f1de9 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:52.989182 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7bad4418-389c-4eb7-b21c-985e247f1de9 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:52.989628 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7bad4418-389c-4eb7-b21c-985e247f1de9 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:53.122874 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-7bad4418-389c-4eb7-b21c-985e247f1de9 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:53.131337 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-7bad4418-389c-4eb7-b21c-985e247f1de9 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2" status: 200 len: 1371 microversion: 2.1 time: 0.156637 Aug 09 18:51:53.131910 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 212/413] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:52 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:51:53.887328 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-9c07e322-e3b6-4d9d-a450-9af58e1ce189 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:53.888012 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-9c07e322-e3b6-4d9d-a450-9af58e1ce189 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:53.899207 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9c07e322-e3b6-4d9d-a450-9af58e1ce189 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:53.899692 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9c07e322-e3b6-4d9d-a450-9af58e1ce189 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:53.900124 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9c07e322-e3b6-4d9d-a450-9af58e1ce189 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:53.900823 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9c07e322-e3b6-4d9d-a450-9af58e1ce189 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:53.901272 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9c07e322-e3b6-4d9d-a450-9af58e1ce189 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:53.901722 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9c07e322-e3b6-4d9d-a450-9af58e1ce189 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:54.043912 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-9c07e322-e3b6-4d9d-a450-9af58e1ce189 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:54.053801 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-9c07e322-e3b6-4d9d-a450-9af58e1ce189 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:54.055319 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-9c07e322-e3b6-4d9d-a450-9af58e1ce189 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:54.056514 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-9c07e322-e3b6-4d9d-a450-9af58e1ce189 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1807 microversion: 2.20 time: 0.173147 Aug 09 18:51:54.057306 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 213/414] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:53 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:51:54.152358 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-2f240112-9f86-44c2-bd73-39aa8b082355 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:54.152890 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-2f240112-9f86-44c2-bd73-39aa8b082355 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:54.159457 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2f240112-9f86-44c2-bd73-39aa8b082355 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:54.162918 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2f240112-9f86-44c2-bd73-39aa8b082355 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:54.162918 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2f240112-9f86-44c2-bd73-39aa8b082355 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:54.162918 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2f240112-9f86-44c2-bd73-39aa8b082355 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:54.162918 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2f240112-9f86-44c2-bd73-39aa8b082355 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:54.163304 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2f240112-9f86-44c2-bd73-39aa8b082355 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:54.353065 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-2f240112-9f86-44c2-bd73-39aa8b082355 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:54.361166 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-2f240112-9f86-44c2-bd73-39aa8b082355 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2" status: 200 len: 1371 microversion: 2.1 time: 0.212762 Aug 09 18:51:54.361774 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 214/415] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:54 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2 => generated 1371 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:51:55.076131 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-4f436130-e13d-4d35-bbd0-f5e3f4923cdc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "POST /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.573158 Aug 09 18:51:55.081321 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 202/416] 10.222.0.57 () {60 vars in 1323 bytes} [Tue Aug 9 18:51:52 2022] POST /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9/os-volume_attachments => generated 194 bytes in 2575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:51:55.082088 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f8cbf472-0d22-4ea1-a977-79a7bdd12b8d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:55.082088 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-f8cbf472-0d22-4ea1-a977-79a7bdd12b8d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:55.087026 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f8cbf472-0d22-4ea1-a977-79a7bdd12b8d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:55.087509 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f8cbf472-0d22-4ea1-a977-79a7bdd12b8d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:55.087939 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f8cbf472-0d22-4ea1-a977-79a7bdd12b8d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:55.088628 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f8cbf472-0d22-4ea1-a977-79a7bdd12b8d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:55.089079 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f8cbf472-0d22-4ea1-a977-79a7bdd12b8d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:55.089501 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f8cbf472-0d22-4ea1-a977-79a7bdd12b8d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:55.220277 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f8cbf472-0d22-4ea1-a977-79a7bdd12b8d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:55.228668 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f8cbf472-0d22-4ea1-a977-79a7bdd12b8d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:55.230226 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f8cbf472-0d22-4ea1-a977-79a7bdd12b8d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:55.231370 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f8cbf472-0d22-4ea1-a977-79a7bdd12b8d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1807 microversion: 2.20 time: 0.156057 Aug 09 18:51:55.231928 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 215/417] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:55 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:51:55.383635 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-ac396dd8-7bf4-4d59-99d1-5295930cd301 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:55.386530 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-ac396dd8-7bf4-4d59-99d1-5295930cd301 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:55.386665 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_api:SELECT=56 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:51:55.392314 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ac396dd8-7bf4-4d59-99d1-5295930cd301 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:55.392990 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ac396dd8-7bf4-4d59-99d1-5295930cd301 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:55.393559 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ac396dd8-7bf4-4d59-99d1-5295930cd301 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:55.394340 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ac396dd8-7bf4-4d59-99d1-5295930cd301 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:55.394866 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ac396dd8-7bf4-4d59-99d1-5295930cd301 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:55.395375 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ac396dd8-7bf4-4d59-99d1-5295930cd301 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:55.540970 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-ac396dd8-7bf4-4d59-99d1-5295930cd301 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:55.549205 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-ac396dd8-7bf4-4d59-99d1-5295930cd301 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2" status: 200 len: 1371 microversion: 2.1 time: 0.170928 Aug 09 18:51:55.550095 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 203/418] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:55 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2 => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:51:56.253481 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f76f7d87-ce27-401f-89a9-64f7e9042fb8 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:56.253481 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-f76f7d87-ce27-401f-89a9-64f7e9042fb8 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:56.260867 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f76f7d87-ce27-401f-89a9-64f7e9042fb8 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:56.267123 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f76f7d87-ce27-401f-89a9-64f7e9042fb8 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:56.267123 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f76f7d87-ce27-401f-89a9-64f7e9042fb8 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:56.267123 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f76f7d87-ce27-401f-89a9-64f7e9042fb8 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:56.267123 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f76f7d87-ce27-401f-89a9-64f7e9042fb8 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:56.268133 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f76f7d87-ce27-401f-89a9-64f7e9042fb8 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:56.404892 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f76f7d87-ce27-401f-89a9-64f7e9042fb8 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:56.414363 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f76f7d87-ce27-401f-89a9-64f7e9042fb8 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:56.416008 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f76f7d87-ce27-401f-89a9-64f7e9042fb8 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:56.417286 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f76f7d87-ce27-401f-89a9-64f7e9042fb8 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1807 microversion: 2.20 time: 0.167747 Aug 09 18:51:56.418529 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 216/419] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:56 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:51:56.570190 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-e4842372-4dbe-4bab-8b82-06c24755c912 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:56.570878 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-e4842372-4dbe-4bab-8b82-06c24755c912 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:56.577344 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e4842372-4dbe-4bab-8b82-06c24755c912 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:56.577859 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e4842372-4dbe-4bab-8b82-06c24755c912 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:56.578866 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e4842372-4dbe-4bab-8b82-06c24755c912 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:56.579479 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e4842372-4dbe-4bab-8b82-06c24755c912 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:56.579930 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e4842372-4dbe-4bab-8b82-06c24755c912 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:56.580372 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e4842372-4dbe-4bab-8b82-06c24755c912 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:56.724138 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-e4842372-4dbe-4bab-8b82-06c24755c912 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:56.731541 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-e4842372-4dbe-4bab-8b82-06c24755c912 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2" status: 200 len: 1565 microversion: 2.1 time: 0.165236 Aug 09 18:51:56.736750 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 204/420] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:51:56 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2 => generated 1565 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:51:56.751701 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-892de966-498f-4e4d-bd2d-26ecc6b818c8 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:56.752186 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-892de966-498f-4e4d-bd2d-26ecc6b818c8 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:56.758249 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-892de966-498f-4e4d-bd2d-26ecc6b818c8 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:56.758922 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-892de966-498f-4e4d-bd2d-26ecc6b818c8 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:56.759381 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-892de966-498f-4e4d-bd2d-26ecc6b818c8 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:56.760080 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-892de966-498f-4e4d-bd2d-26ecc6b818c8 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:56.760531 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-892de966-498f-4e4d-bd2d-26ecc6b818c8 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:56.760946 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-892de966-498f-4e4d-bd2d-26ecc6b818c8 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:56.840697 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-892de966-498f-4e4d-bd2d-26ecc6b818c8 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093254 Aug 09 18:51:56.841472 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 217/421] 10.222.0.57 () {58 vars in 1275 bytes} [Tue Aug 9 18:51:56 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:51:57.440891 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-39239a40-a79b-41af-8b4c-a5be28037afb tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:57.441666 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-39239a40-a79b-41af-8b4c-a5be28037afb tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:57.447622 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-39239a40-a79b-41af-8b4c-a5be28037afb tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:57.448103 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-39239a40-a79b-41af-8b4c-a5be28037afb tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:57.448535 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-39239a40-a79b-41af-8b4c-a5be28037afb tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:57.449233 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-39239a40-a79b-41af-8b4c-a5be28037afb tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:57.449719 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-39239a40-a79b-41af-8b4c-a5be28037afb tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:57.450146 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-39239a40-a79b-41af-8b4c-a5be28037afb tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:57.583352 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-39239a40-a79b-41af-8b4c-a5be28037afb tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:57.592478 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-39239a40-a79b-41af-8b4c-a5be28037afb tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:57.593991 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-39239a40-a79b-41af-8b4c-a5be28037afb tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:57.595653 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-39239a40-a79b-41af-8b4c-a5be28037afb tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1807 microversion: 2.20 time: 0.159341 Aug 09 18:51:57.596206 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 205/422] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:57 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:51:58.035099 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-a4784da0-f04a-419a-888c-ef84b8372360 req-f2ce82b1-806c-49f1-bd02-ca484bc5cad8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e15bc2b4-4702-4ee5-9483-87db30954da2", "tag": "6d0d654f-2f8f-4f17-bf93-aa249db5c6d8"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:51:58.044962 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-a4784da0-f04a-419a-888c-ef84b8372360 req-f2ce82b1-806c-49f1-bd02-ca484bc5cad8 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:58.047318 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-a4784da0-f04a-419a-888c-ef84b8372360 req-f2ce82b1-806c-49f1-bd02-ca484bc5cad8 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:58.047318 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-a4784da0-f04a-419a-888c-ef84b8372360 req-f2ce82b1-806c-49f1-bd02-ca484bc5cad8 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:58.059277 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-a4784da0-f04a-419a-888c-ef84b8372360 req-f2ce82b1-806c-49f1-bd02-ca484bc5cad8 service nova] Creating event network-changed:6d0d654f-2f8f-4f17-bf93-aa249db5c6d8 for instance e15bc2b4-4702-4ee5-9483-87db30954da2 on hv-cinder-82660 Aug 09 18:51:58.064935 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-a4784da0-f04a-419a-888c-ef84b8372360 req-f2ce82b1-806c-49f1-bd02-ca484bc5cad8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034571 Aug 09 18:51:58.065574 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 218/423] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:51:58.619696 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-942ba68a-7296-44c5-8316-f3f328373678 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:58.620392 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-942ba68a-7296-44c5-8316-f3f328373678 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:58.628462 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-942ba68a-7296-44c5-8316-f3f328373678 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:58.628959 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-942ba68a-7296-44c5-8316-f3f328373678 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:58.629543 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-942ba68a-7296-44c5-8316-f3f328373678 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:58.630255 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-942ba68a-7296-44c5-8316-f3f328373678 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:58.630705 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-942ba68a-7296-44c5-8316-f3f328373678 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:58.631132 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-942ba68a-7296-44c5-8316-f3f328373678 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:58.772938 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-942ba68a-7296-44c5-8316-f3f328373678 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:58.781787 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-942ba68a-7296-44c5-8316-f3f328373678 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:58.783348 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-942ba68a-7296-44c5-8316-f3f328373678 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:58.784556 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-942ba68a-7296-44c5-8316-f3f328373678 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1807 microversion: 2.20 time: 0.168760 Aug 09 18:51:58.785117 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 206/424] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:58 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:51:59.809072 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-4080355f-cb6b-4590-b098-9a5411910261 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:51:59.809805 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-4080355f-cb6b-4590-b098-9a5411910261 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:51:59.816473 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4080355f-cb6b-4590-b098-9a5411910261 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:59.816955 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4080355f-cb6b-4590-b098-9a5411910261 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:59.817390 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4080355f-cb6b-4590-b098-9a5411910261 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:59.818106 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4080355f-cb6b-4590-b098-9a5411910261 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:51:59.818562 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4080355f-cb6b-4590-b098-9a5411910261 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:51:59.818985 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4080355f-cb6b-4590-b098-9a5411910261 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:51:59.948296 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-4080355f-cb6b-4590-b098-9a5411910261 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:59.957966 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-4080355f-cb6b-4590-b098-9a5411910261 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:59.959748 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-4080355f-cb6b-4590-b098-9a5411910261 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:51:59.960937 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-4080355f-cb6b-4590-b098-9a5411910261 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1807 microversion: 2.20 time: 0.156844 Aug 09 18:51:59.961698 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 219/425] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:51:59 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:52:00.983417 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-3a71b2ec-b10c-4cbd-8812-7902645b5ce6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:00.984004 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-3a71b2ec-b10c-4cbd-8812-7902645b5ce6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:00.990652 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3a71b2ec-b10c-4cbd-8812-7902645b5ce6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:00.991139 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3a71b2ec-b10c-4cbd-8812-7902645b5ce6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:00.991573 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3a71b2ec-b10c-4cbd-8812-7902645b5ce6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:00.992265 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3a71b2ec-b10c-4cbd-8812-7902645b5ce6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:00.992717 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3a71b2ec-b10c-4cbd-8812-7902645b5ce6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:00.993141 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3a71b2ec-b10c-4cbd-8812-7902645b5ce6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:01.122317 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-3a71b2ec-b10c-4cbd-8812-7902645b5ce6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:01.130765 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-3a71b2ec-b10c-4cbd-8812-7902645b5ce6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:01.132453 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-3a71b2ec-b10c-4cbd-8812-7902645b5ce6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:01.133609 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-3a71b2ec-b10c-4cbd-8812-7902645b5ce6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1807 microversion: 2.20 time: 0.154139 Aug 09 18:52:01.134156 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 207/426] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:52:00 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:52:02.157228 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e1bc1295-82de-46f4-8612-af2817b61b31 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:02.157847 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e1bc1295-82de-46f4-8612-af2817b61b31 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:02.164262 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e1bc1295-82de-46f4-8612-af2817b61b31 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:02.164750 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e1bc1295-82de-46f4-8612-af2817b61b31 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:02.165181 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e1bc1295-82de-46f4-8612-af2817b61b31 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:02.165900 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e1bc1295-82de-46f4-8612-af2817b61b31 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:02.166357 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e1bc1295-82de-46f4-8612-af2817b61b31 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:02.166779 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e1bc1295-82de-46f4-8612-af2817b61b31 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:02.308309 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e1bc1295-82de-46f4-8612-af2817b61b31 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:02.312652 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=100 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:52:02.318342 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e1bc1295-82de-46f4-8612-af2817b61b31 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:02.319834 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e1bc1295-82de-46f4-8612-af2817b61b31 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:02.321019 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e1bc1295-82de-46f4-8612-af2817b61b31 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1807 microversion: 2.20 time: 0.168165 Aug 09 18:52:02.321591 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 220/427] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:52:02 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:52:03.346355 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-1a3dee3a-8529-4762-8d08-8e587a127fca tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:03.346974 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-1a3dee3a-8529-4762-8d08-8e587a127fca tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:03.353492 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1a3dee3a-8529-4762-8d08-8e587a127fca tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:03.354007 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1a3dee3a-8529-4762-8d08-8e587a127fca tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:03.354441 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1a3dee3a-8529-4762-8d08-8e587a127fca tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:03.355131 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1a3dee3a-8529-4762-8d08-8e587a127fca tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:03.355579 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1a3dee3a-8529-4762-8d08-8e587a127fca tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:03.356000 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1a3dee3a-8529-4762-8d08-8e587a127fca tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:03.495302 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-1a3dee3a-8529-4762-8d08-8e587a127fca tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:03.506184 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-1a3dee3a-8529-4762-8d08-8e587a127fca tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:03.506184 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-1a3dee3a-8529-4762-8d08-8e587a127fca tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:03.507253 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-1a3dee3a-8529-4762-8d08-8e587a127fca tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1807 microversion: 2.20 time: 0.165435 Aug 09 18:52:03.507810 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 208/428] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:52:03 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:52:03.667257 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5ef8c92f-4e8d-4685-8811-388e119b0b53 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Action: 'create', calling method: .version_select at 0x7f8d697069d0>, body: {"keypair": {"name": "tempest-keypair-205942855", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmRJxgt8rvYr38CHpUa7+WJH4isE/fCW6Yd5+obBmC5UnoCfMKobdRZbgoOKWYA5K/TSU9MQxgJEnkb6kwY+hbU3w1rymPPew7RO75dLOJsSdiT9XaIp4v1o4vYrXHYBw=="}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:52:03.684328 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-5ef8c92f-4e8d-4685-8811-388e119b0b53 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Getting quotas for project 4a745db383cb452187f7c82b9977c09b. Resources: {'key_pairs'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:52:03.688889 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-5ef8c92f-4e8d-4685-8811-388e119b0b53 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Getting quotas for user 00491255f4b44125b6dc9f816c9bbb58 and project 4a745db383cb452187f7c82b9977c09b. Resources: {'key_pairs'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:52:03.776266 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-5ef8c92f-4e8d-4685-8811-388e119b0b53 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.113390 Aug 09 18:52:03.777108 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 221/429] 10.222.0.57 () {60 vars in 1159 bytes} [Tue Aug 9 18:52:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:52:03.891212 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-fca22a89-50d0-409b-b02f-5d0b0daa3030 req-7dda9d37-08b2-45be-89c1-89df5df284df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22aac118-db08-4aca-a5e7-3f2cad5e49fd", "name": "network-vif-plugged", "status": "completed", "tag": "7a0b7c9e-84bf-4317-b8ea-f03780b0d3b2"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:52:03.901402 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-fca22a89-50d0-409b-b02f-5d0b0daa3030 req-7dda9d37-08b2-45be-89c1-89df5df284df service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:03.901903 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-fca22a89-50d0-409b-b02f-5d0b0daa3030 req-7dda9d37-08b2-45be-89c1-89df5df284df service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:03.902320 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-fca22a89-50d0-409b-b02f-5d0b0daa3030 req-7dda9d37-08b2-45be-89c1-89df5df284df service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:03.913249 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-fca22a89-50d0-409b-b02f-5d0b0daa3030 req-7dda9d37-08b2-45be-89c1-89df5df284df service nova] Creating event network-vif-plugged:7a0b7c9e-84bf-4317-b8ea-f03780b0d3b2 for instance 22aac118-db08-4aca-a5e7-3f2cad5e49fd on hv-cinder-82660 Aug 09 18:52:03.918391 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-fca22a89-50d0-409b-b02f-5d0b0daa3030 req-7dda9d37-08b2-45be-89c1-89df5df284df service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031308 Aug 09 18:52:03.920350 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 209/430] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:52:04.532280 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f7e384cc-4689-44c9-8fb2-70782e4f2b51 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:04.533171 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-f7e384cc-4689-44c9-8fb2-70782e4f2b51 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:04.539326 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f7e384cc-4689-44c9-8fb2-70782e4f2b51 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:04.539811 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f7e384cc-4689-44c9-8fb2-70782e4f2b51 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:04.540247 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f7e384cc-4689-44c9-8fb2-70782e4f2b51 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:04.540940 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f7e384cc-4689-44c9-8fb2-70782e4f2b51 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:04.541395 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f7e384cc-4689-44c9-8fb2-70782e4f2b51 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:04.541881 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f7e384cc-4689-44c9-8fb2-70782e4f2b51 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:04.771141 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f7e384cc-4689-44c9-8fb2-70782e4f2b51 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:04.779740 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f7e384cc-4689-44c9-8fb2-70782e4f2b51 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:04.781239 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f7e384cc-4689-44c9-8fb2-70782e4f2b51 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:04.783035 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f7e384cc-4689-44c9-8fb2-70782e4f2b51 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1807 microversion: 2.20 time: 0.255530 Aug 09 18:52:04.783689 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 222/431] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:52:04 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1807 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:52:05.807115 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-a4a00f5f-7d56-4a9b-9197-72c42b69f5c6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:05.807838 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-a4a00f5f-7d56-4a9b-9197-72c42b69f5c6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:05.814066 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a4a00f5f-7d56-4a9b-9197-72c42b69f5c6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:05.814544 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a4a00f5f-7d56-4a9b-9197-72c42b69f5c6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:05.815255 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a4a00f5f-7d56-4a9b-9197-72c42b69f5c6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:05.815791 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a4a00f5f-7d56-4a9b-9197-72c42b69f5c6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:05.816244 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a4a00f5f-7d56-4a9b-9197-72c42b69f5c6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:05.816668 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a4a00f5f-7d56-4a9b-9197-72c42b69f5c6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:05.948985 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-a4a00f5f-7d56-4a9b-9197-72c42b69f5c6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:05.958342 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-a4a00f5f-7d56-4a9b-9197-72c42b69f5c6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:05.959865 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-a4a00f5f-7d56-4a9b-9197-72c42b69f5c6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:05.961050 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-a4a00f5f-7d56-4a9b-9197-72c42b69f5c6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1807 microversion: 2.20 time: 0.158802 Aug 09 18:52:05.961653 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 210/432] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:52:05 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:52:06.097798 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e69a024e-c22e-43c9-9d5c-4a15af39a13b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-203561565", "imageRef": "124dd477-ccfa-4be3-9973-6b1f33b47df8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c83a464f-4efd-4554-9508-d2b73d3a8a45"}], "security_groups": [{"name": "tempest-securitygroup--269659029"}], "key_name": "tempest-keypair-205942855", "user_data": "}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:52:06.202447 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.network.neutron [None req-e69a024e-c22e-43c9-9d5c-4a15af39a13b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] validate_networks() for [('c83a464f-4efd-4554-9508-d2b73d3a8a45', None, None, None, None, None)] {{(pid=124725) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:52:06.575103 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-e69a024e-c22e-43c9-9d5c-4a15af39a13b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Flavor limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:52:06.575529 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-e69a024e-c22e-43c9-9d5c-4a15af39a13b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Image limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:52:06.575989 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-e69a024e-c22e-43c9-9d5c-4a15af39a13b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Flavor pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:52:06.576387 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-e69a024e-c22e-43c9-9d5c-4a15af39a13b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Image pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:52:06.576798 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-e69a024e-c22e-43c9-9d5c-4a15af39a13b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:52:06.586268 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e69a024e-c22e-43c9-9d5c-4a15af39a13b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:06.586737 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e69a024e-c22e-43c9-9d5c-4a15af39a13b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:06.587165 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e69a024e-c22e-43c9-9d5c-4a15af39a13b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:06.587874 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e69a024e-c22e-43c9-9d5c-4a15af39a13b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:06.588318 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e69a024e-c22e-43c9-9d5c-4a15af39a13b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:06.588731 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e69a024e-c22e-43c9-9d5c-4a15af39a13b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:06.605590 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-e69a024e-c22e-43c9-9d5c-4a15af39a13b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Getting quotas for project 4a745db383cb452187f7c82b9977c09b. Resources: {'cores', 'ram', 'instances'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:52:06.609476 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-e69a024e-c22e-43c9-9d5c-4a15af39a13b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Getting quotas for user 00491255f4b44125b6dc9f816c9bbb58 and project 4a745db383cb452187f7c82b9977c09b. Resources: {'cores', 'ram', 'instances'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:52:06.620891 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e69a024e-c22e-43c9-9d5c-4a15af39a13b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Going to run 1 instances... {{(pid=124725) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:52:06.623155 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e69a024e-c22e-43c9-9d5c-4a15af39a13b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 6ba05bdf-8754-4e31-976a-816a4485a252] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='124dd477-ccfa-4be3-9973-6b1f33b47df8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:52:06.736940 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e69a024e-c22e-43c9-9d5c-4a15af39a13b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.644104 Aug 09 18:52:06.737646 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 223/433] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 9 18:52:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:52:06.748409 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-b4e153aa-f115-4cab-86b6-04b82b3c7dd8 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:06.749117 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-b4e153aa-f115-4cab-86b6-04b82b3c7dd8 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 6ba05bdf-8754-4e31-976a-816a4485a252] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:06.805958 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-b4e153aa-f115-4cab-86b6-04b82b3c7dd8 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:06.813644 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-b4e153aa-f115-4cab-86b6-04b82b3c7dd8 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252" status: 200 len: 1240 microversion: 2.1 time: 0.069059 Aug 09 18:52:06.814237 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 211/434] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:52:06 2022] GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252 => generated 1240 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:52:06.987915 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-76f85184-5953-4a78-9ee8-0eba0ece6d39 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:06.987915 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-76f85184-5953-4a78-9ee8-0eba0ece6d39 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:06.992205 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-76f85184-5953-4a78-9ee8-0eba0ece6d39 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:06.992714 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-76f85184-5953-4a78-9ee8-0eba0ece6d39 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:06.993264 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-76f85184-5953-4a78-9ee8-0eba0ece6d39 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:06.993993 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-76f85184-5953-4a78-9ee8-0eba0ece6d39 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:06.994502 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-76f85184-5953-4a78-9ee8-0eba0ece6d39 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:06.994925 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-76f85184-5953-4a78-9ee8-0eba0ece6d39 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:07.131871 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-76f85184-5953-4a78-9ee8-0eba0ece6d39 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:07.140473 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-76f85184-5953-4a78-9ee8-0eba0ece6d39 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:07.148305 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-76f85184-5953-4a78-9ee8-0eba0ece6d39 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:07.148305 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-76f85184-5953-4a78-9ee8-0eba0ece6d39 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1807 microversion: 2.20 time: 0.163435 Aug 09 18:52:07.148305 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 224/435] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:52:06 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:52:07.834222 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-10528051-70d1-4147-a6b3-903d9ac4bdc4 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:07.834834 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-10528051-70d1-4147-a6b3-903d9ac4bdc4 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 6ba05bdf-8754-4e31-976a-816a4485a252] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:07.842002 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-10528051-70d1-4147-a6b3-903d9ac4bdc4 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:07.842525 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-10528051-70d1-4147-a6b3-903d9ac4bdc4 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:07.842964 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-10528051-70d1-4147-a6b3-903d9ac4bdc4 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:07.843665 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-10528051-70d1-4147-a6b3-903d9ac4bdc4 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:07.844119 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-10528051-70d1-4147-a6b3-903d9ac4bdc4 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:07.844544 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-10528051-70d1-4147-a6b3-903d9ac4bdc4 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:07.907822 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-10528051-70d1-4147-a6b3-903d9ac4bdc4 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:07.915614 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-10528051-70d1-4147-a6b3-903d9ac4bdc4 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252" status: 200 len: 1244 microversion: 2.1 time: 0.085352 Aug 09 18:52:07.916182 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 212/436] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:52:07 2022] GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:52:08.167587 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-cb4b7e56-c024-4a0c-9c76-7aa827262660 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:08.168195 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-cb4b7e56-c024-4a0c-9c76-7aa827262660 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:08.177269 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cb4b7e56-c024-4a0c-9c76-7aa827262660 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:08.177911 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cb4b7e56-c024-4a0c-9c76-7aa827262660 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:08.178372 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cb4b7e56-c024-4a0c-9c76-7aa827262660 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:08.179084 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cb4b7e56-c024-4a0c-9c76-7aa827262660 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:08.179535 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cb4b7e56-c024-4a0c-9c76-7aa827262660 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:08.180004 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cb4b7e56-c024-4a0c-9c76-7aa827262660 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:08.319790 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-cb4b7e56-c024-4a0c-9c76-7aa827262660 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:08.329009 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-cb4b7e56-c024-4a0c-9c76-7aa827262660 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:08.330559 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-cb4b7e56-c024-4a0c-9c76-7aa827262660 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:08.331715 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-cb4b7e56-c024-4a0c-9c76-7aa827262660 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1807 microversion: 2.20 time: 0.168202 Aug 09 18:52:08.332326 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 225/437] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:52:08 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:52:08.937423 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-71905ae1-9227-420a-88c5-cffce12a3eeb tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:08.938967 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-71905ae1-9227-420a-88c5-cffce12a3eeb tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 6ba05bdf-8754-4e31-976a-816a4485a252] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:08.945315 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-71905ae1-9227-420a-88c5-cffce12a3eeb tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:08.945843 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-71905ae1-9227-420a-88c5-cffce12a3eeb tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:08.946278 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-71905ae1-9227-420a-88c5-cffce12a3eeb tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:08.946989 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-71905ae1-9227-420a-88c5-cffce12a3eeb tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:08.947495 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-71905ae1-9227-420a-88c5-cffce12a3eeb tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:08.947924 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-71905ae1-9227-420a-88c5-cffce12a3eeb tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:09.019351 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-71905ae1-9227-420a-88c5-cffce12a3eeb tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:09.027386 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-71905ae1-9227-420a-88c5-cffce12a3eeb tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252" status: 200 len: 1300 microversion: 2.1 time: 0.093754 Aug 09 18:52:09.027979 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 213/438] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:52:08 2022] GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252 => generated 1300 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:52:09.355648 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-79a4bc05-a72b-4551-b16c-d505539f7201 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:09.356268 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-79a4bc05-a72b-4551-b16c-d505539f7201 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:09.358743 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=4 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:52:09.364276 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-79a4bc05-a72b-4551-b16c-d505539f7201 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:09.364765 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-79a4bc05-a72b-4551-b16c-d505539f7201 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:09.371765 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-79a4bc05-a72b-4551-b16c-d505539f7201 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:09.371765 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-79a4bc05-a72b-4551-b16c-d505539f7201 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:09.371765 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-79a4bc05-a72b-4551-b16c-d505539f7201 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:09.371765 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-79a4bc05-a72b-4551-b16c-d505539f7201 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:09.707326 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-79a4bc05-a72b-4551-b16c-d505539f7201 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:09.716427 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-79a4bc05-a72b-4551-b16c-d505539f7201 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:09.717968 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-79a4bc05-a72b-4551-b16c-d505539f7201 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:09.719141 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-79a4bc05-a72b-4551-b16c-d505539f7201 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1794 microversion: 2.20 time: 0.367542 Aug 09 18:52:09.726610 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 226/439] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:52:09 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1794 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:52:10.051649 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-576d4803-3dea-4888-bfab-f464ac42edf0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:10.052886 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-576d4803-3dea-4888-bfab-f464ac42edf0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 6ba05bdf-8754-4e31-976a-816a4485a252] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:10.060265 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-576d4803-3dea-4888-bfab-f464ac42edf0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:10.060758 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-576d4803-3dea-4888-bfab-f464ac42edf0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:10.061207 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-576d4803-3dea-4888-bfab-f464ac42edf0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:10.061931 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-576d4803-3dea-4888-bfab-f464ac42edf0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:10.062386 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-576d4803-3dea-4888-bfab-f464ac42edf0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:10.062816 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-576d4803-3dea-4888-bfab-f464ac42edf0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:10.222058 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-576d4803-3dea-4888-bfab-f464ac42edf0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:10.228323 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-576d4803-3dea-4888-bfab-f464ac42edf0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252" status: 200 len: 1365 microversion: 2.1 time: 0.181461 Aug 09 18:52:10.229085 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 214/440] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:52:10 2022] GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252 => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:52:10.920885 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-45a748e3-8c8f-460a-8393-7d7efe6bd85d req-17b53b05-31f4-4d69-991b-d9bf44b385b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ba05bdf-8754-4e31-976a-816a4485a252", "tag": "43d43174-05ce-4aa4-847d-a37146ed16a3"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:52:10.933704 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-45a748e3-8c8f-460a-8393-7d7efe6bd85d req-17b53b05-31f4-4d69-991b-d9bf44b385b4 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:10.934255 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-45a748e3-8c8f-460a-8393-7d7efe6bd85d req-17b53b05-31f4-4d69-991b-d9bf44b385b4 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:10.934705 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-45a748e3-8c8f-460a-8393-7d7efe6bd85d req-17b53b05-31f4-4d69-991b-d9bf44b385b4 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:10.946406 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-45a748e3-8c8f-460a-8393-7d7efe6bd85d req-17b53b05-31f4-4d69-991b-d9bf44b385b4 service nova] Creating event network-changed:43d43174-05ce-4aa4-847d-a37146ed16a3 for instance 6ba05bdf-8754-4e31-976a-816a4485a252 on hv-cinder-82660 Aug 09 18:52:10.951888 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-45a748e3-8c8f-460a-8393-7d7efe6bd85d req-17b53b05-31f4-4d69-991b-d9bf44b385b4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036067 Aug 09 18:52:10.952721 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 227/441] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:52:11.250344 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-9ec5ad2c-821e-4f46-8087-a15188622de0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:11.252522 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-9ec5ad2c-821e-4f46-8087-a15188622de0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 6ba05bdf-8754-4e31-976a-816a4485a252] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:11.258845 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9ec5ad2c-821e-4f46-8087-a15188622de0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:11.263756 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9ec5ad2c-821e-4f46-8087-a15188622de0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:11.263756 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9ec5ad2c-821e-4f46-8087-a15188622de0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:11.263756 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9ec5ad2c-821e-4f46-8087-a15188622de0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:11.263756 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9ec5ad2c-821e-4f46-8087-a15188622de0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:11.264150 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9ec5ad2c-821e-4f46-8087-a15188622de0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:11.401709 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-9ec5ad2c-821e-4f46-8087-a15188622de0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:11.409954 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-9ec5ad2c-821e-4f46-8087-a15188622de0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252" status: 200 len: 1365 microversion: 2.1 time: 0.163643 Aug 09 18:52:11.410532 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 215/442] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:52:11 2022] GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:52:12.431372 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-af2f7a6a-363d-4c80-bbcf-33b3b5d00247 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:12.432077 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-af2f7a6a-363d-4c80-bbcf-33b3b5d00247 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 6ba05bdf-8754-4e31-976a-816a4485a252] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:12.438701 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-af2f7a6a-363d-4c80-bbcf-33b3b5d00247 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:12.439181 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-af2f7a6a-363d-4c80-bbcf-33b3b5d00247 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:12.439616 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-af2f7a6a-363d-4c80-bbcf-33b3b5d00247 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:12.440319 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-af2f7a6a-363d-4c80-bbcf-33b3b5d00247 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:12.440759 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-af2f7a6a-363d-4c80-bbcf-33b3b5d00247 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:12.441182 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-af2f7a6a-363d-4c80-bbcf-33b3b5d00247 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:12.573189 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-af2f7a6a-363d-4c80-bbcf-33b3b5d00247 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:12.580823 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-af2f7a6a-363d-4c80-bbcf-33b3b5d00247 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252" status: 200 len: 1365 microversion: 2.1 time: 0.153589 Aug 09 18:52:12.581395 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 228/443] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:52:12 2022] GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:52:13.601228 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-70c2075f-77d7-4bc6-883b-c25269367bd3 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:13.601863 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-70c2075f-77d7-4bc6-883b-c25269367bd3 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 6ba05bdf-8754-4e31-976a-816a4485a252] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:13.608473 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-70c2075f-77d7-4bc6-883b-c25269367bd3 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:13.608950 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-70c2075f-77d7-4bc6-883b-c25269367bd3 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:13.609383 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-70c2075f-77d7-4bc6-883b-c25269367bd3 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:13.610680 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-70c2075f-77d7-4bc6-883b-c25269367bd3 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:13.611138 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-70c2075f-77d7-4bc6-883b-c25269367bd3 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:13.611562 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-70c2075f-77d7-4bc6-883b-c25269367bd3 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:13.744400 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-70c2075f-77d7-4bc6-883b-c25269367bd3 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:13.752490 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-70c2075f-77d7-4bc6-883b-c25269367bd3 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252" status: 200 len: 1365 microversion: 2.1 time: 0.155164 Aug 09 18:52:13.753098 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 216/444] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:52:13 2022] GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:52:14.773137 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-9b56a008-21c6-4cfa-8e4d-348abdb67a12 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:14.773778 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-9b56a008-21c6-4cfa-8e4d-348abdb67a12 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 6ba05bdf-8754-4e31-976a-816a4485a252] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:14.780277 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9b56a008-21c6-4cfa-8e4d-348abdb67a12 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:14.780757 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9b56a008-21c6-4cfa-8e4d-348abdb67a12 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:14.781193 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9b56a008-21c6-4cfa-8e4d-348abdb67a12 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:14.781983 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9b56a008-21c6-4cfa-8e4d-348abdb67a12 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:14.782642 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9b56a008-21c6-4cfa-8e4d-348abdb67a12 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:14.783250 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9b56a008-21c6-4cfa-8e4d-348abdb67a12 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:14.912725 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-9b56a008-21c6-4cfa-8e4d-348abdb67a12 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:14.920091 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-9b56a008-21c6-4cfa-8e4d-348abdb67a12 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252" status: 200 len: 1365 microversion: 2.1 time: 0.150931 Aug 09 18:52:14.920658 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 229/445] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:52:14 2022] GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:52:15.941463 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-fc3f00f6-5ecb-4ff5-ba01-266707b870bc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:15.942080 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-fc3f00f6-5ecb-4ff5-ba01-266707b870bc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 6ba05bdf-8754-4e31-976a-816a4485a252] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:15.948743 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fc3f00f6-5ecb-4ff5-ba01-266707b870bc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:15.952158 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fc3f00f6-5ecb-4ff5-ba01-266707b870bc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:15.952158 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fc3f00f6-5ecb-4ff5-ba01-266707b870bc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:15.952158 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fc3f00f6-5ecb-4ff5-ba01-266707b870bc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:15.952158 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fc3f00f6-5ecb-4ff5-ba01-266707b870bc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:15.953236 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fc3f00f6-5ecb-4ff5-ba01-266707b870bc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:15.955809 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:52:16.082394 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-fc3f00f6-5ecb-4ff5-ba01-266707b870bc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:16.089565 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-fc3f00f6-5ecb-4ff5-ba01-266707b870bc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252" status: 200 len: 1365 microversion: 2.1 time: 0.151977 Aug 09 18:52:16.090350 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 217/446] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:52:15 2022] GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:52:17.111139 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-56796250-80bd-40ae-bb9a-e4484f5397c3 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:17.111808 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-56796250-80bd-40ae-bb9a-e4484f5397c3 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 6ba05bdf-8754-4e31-976a-816a4485a252] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:17.113908 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=2 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:52:17.114577 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=10 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:52:17.119359 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-56796250-80bd-40ae-bb9a-e4484f5397c3 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:17.119842 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-56796250-80bd-40ae-bb9a-e4484f5397c3 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:17.120277 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-56796250-80bd-40ae-bb9a-e4484f5397c3 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:17.120974 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-56796250-80bd-40ae-bb9a-e4484f5397c3 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:17.121440 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-56796250-80bd-40ae-bb9a-e4484f5397c3 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:17.121902 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-56796250-80bd-40ae-bb9a-e4484f5397c3 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:17.254215 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-56796250-80bd-40ae-bb9a-e4484f5397c3 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:17.262905 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-56796250-80bd-40ae-bb9a-e4484f5397c3 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252" status: 200 len: 1365 microversion: 2.1 time: 0.156454 Aug 09 18:52:17.263702 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 230/447] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:52:17 2022] GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:52:17.890821 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-9ca3139d-1071-4094-99b2-f6e6e6b2d049 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:17.891442 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-9ca3139d-1071-4094-99b2-f6e6e6b2d049 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:17.893878 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell0:SELECT=2 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:52:17.900019 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9ca3139d-1071-4094-99b2-f6e6e6b2d049 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:17.900508 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9ca3139d-1071-4094-99b2-f6e6e6b2d049 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:17.900938 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9ca3139d-1071-4094-99b2-f6e6e6b2d049 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:17.901852 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9ca3139d-1071-4094-99b2-f6e6e6b2d049 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:17.902355 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9ca3139d-1071-4094-99b2-f6e6e6b2d049 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:17.902764 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9ca3139d-1071-4094-99b2-f6e6e6b2d049 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:18.033670 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.objects.instance [None req-9ca3139d-1071-4094-99b2-f6e6e6b2d049 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lazy-loading 'services' on Instance uuid ec125ee9-c66e-4b3d-9304-ef14211241af {{(pid=124726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:52:18.048752 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-58339ab0-9b44-4c04-a1b7-28689ef4ec93 req-3e295ac2-58e6-406e-ba8d-b1b9d4e56196 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ba05bdf-8754-4e31-976a-816a4485a252", "name": "network-vif-plugged", "status": "completed", "tag": "43d43174-05ce-4aa4-847d-a37146ed16a3"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:52:18.058586 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-58339ab0-9b44-4c04-a1b7-28689ef4ec93 req-3e295ac2-58e6-406e-ba8d-b1b9d4e56196 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:18.059432 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-58339ab0-9b44-4c04-a1b7-28689ef4ec93 req-3e295ac2-58e6-406e-ba8d-b1b9d4e56196 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:18.059961 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-58339ab0-9b44-4c04-a1b7-28689ef4ec93 req-3e295ac2-58e6-406e-ba8d-b1b9d4e56196 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:18.071289 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-58339ab0-9b44-4c04-a1b7-28689ef4ec93 req-3e295ac2-58e6-406e-ba8d-b1b9d4e56196 service nova] Creating event network-vif-plugged:43d43174-05ce-4aa4-847d-a37146ed16a3 for instance 6ba05bdf-8754-4e31-976a-816a4485a252 on hv-cinder-82660 Aug 09 18:52:18.076210 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-58339ab0-9b44-4c04-a1b7-28689ef4ec93 req-3e295ac2-58e6-406e-ba8d-b1b9d4e56196 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031275 Aug 09 18:52:18.076807 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 231/448] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:52:18.286440 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f5bb30ee-24d2-45a4-8982-655b4226ba2d tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:18.287691 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-f5bb30ee-24d2-45a4-8982-655b4226ba2d tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 6ba05bdf-8754-4e31-976a-816a4485a252] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:18.305129 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f5bb30ee-24d2-45a4-8982-655b4226ba2d tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:18.305772 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f5bb30ee-24d2-45a4-8982-655b4226ba2d tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:18.306286 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f5bb30ee-24d2-45a4-8982-655b4226ba2d tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:18.307090 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f5bb30ee-24d2-45a4-8982-655b4226ba2d tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:18.307623 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f5bb30ee-24d2-45a4-8982-655b4226ba2d tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:18.308105 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f5bb30ee-24d2-45a4-8982-655b4226ba2d tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:18.328918 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-9ca3139d-1071-4094-99b2-f6e6e6b2d049 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af/os-volume_attachments/d7dcbbf4-0719-4dcd-b558-a3be4636e7db" status: 202 len: 0 microversion: 2.1 time: 0.442007 Aug 09 18:52:18.330066 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 218/449] 10.222.0.57 () {58 vars in 1416 bytes} [Tue Aug 9 18:52:17 2022] DELETE /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af/os-volume_attachments/d7dcbbf4-0719-4dcd-b558-a3be4636e7db => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:52:18.541408 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f5bb30ee-24d2-45a4-8982-655b4226ba2d tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:18.550571 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f5bb30ee-24d2-45a4-8982-655b4226ba2d tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252" status: 200 len: 1365 microversion: 2.1 time: 0.268489 Aug 09 18:52:18.550571 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 232/450] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:52:18 2022] GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252 => generated 1365 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:52:19.571871 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-ee0b6185-db44-492a-bb37-fc1593fbb735 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:19.572558 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-ee0b6185-db44-492a-bb37-fc1593fbb735 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 6ba05bdf-8754-4e31-976a-816a4485a252] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:19.579364 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ee0b6185-db44-492a-bb37-fc1593fbb735 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:19.579837 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ee0b6185-db44-492a-bb37-fc1593fbb735 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:19.580261 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ee0b6185-db44-492a-bb37-fc1593fbb735 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:19.580935 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ee0b6185-db44-492a-bb37-fc1593fbb735 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:19.581379 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ee0b6185-db44-492a-bb37-fc1593fbb735 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:19.581826 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ee0b6185-db44-492a-bb37-fc1593fbb735 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:19.715985 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-ee0b6185-db44-492a-bb37-fc1593fbb735 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:19.723528 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-ee0b6185-db44-492a-bb37-fc1593fbb735 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252" status: 200 len: 1365 microversion: 2.1 time: 0.156293 Aug 09 18:52:19.724101 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 219/451] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:52:19 2022] GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:52:20.515061 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-dc79b164-cbe5-46a7-85fd-e5bfdde952df tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:52:20.522161 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dc79b164-cbe5-46a7-85fd-e5bfdde952df tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:20.522639 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dc79b164-cbe5-46a7-85fd-e5bfdde952df tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:20.523077 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dc79b164-cbe5-46a7-85fd-e5bfdde952df tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:20.546894 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-dc79b164-cbe5-46a7-85fd-e5bfdde952df tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Going to try to stop instance {{(pid=124725) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 09 18:52:20.732705 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-dc79b164-cbe5-46a7-85fd-e5bfdde952df tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "POST /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af/action" status: 202 len: 0 microversion: 2.1 time: 0.221227 Aug 09 18:52:20.733240 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 233/452] 10.222.0.57 () {60 vars in 1278 bytes} [Tue Aug 9 18:52:20 2022] POST /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:52:20.741328 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-b29af78a-0ba9-4d3a-8637-47201d8d2a4e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:20.742001 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-b29af78a-0ba9-4d3a-8637-47201d8d2a4e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:20.745463 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-61ca0d5e-da69-435d-b416-d447f6666646 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:20.746107 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-61ca0d5e-da69-435d-b416-d447f6666646 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 6ba05bdf-8754-4e31-976a-816a4485a252] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:20.748557 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b29af78a-0ba9-4d3a-8637-47201d8d2a4e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:20.749050 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b29af78a-0ba9-4d3a-8637-47201d8d2a4e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:20.749588 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b29af78a-0ba9-4d3a-8637-47201d8d2a4e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:20.750233 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b29af78a-0ba9-4d3a-8637-47201d8d2a4e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:20.751208 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b29af78a-0ba9-4d3a-8637-47201d8d2a4e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:20.751778 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b29af78a-0ba9-4d3a-8637-47201d8d2a4e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:20.754663 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-61ca0d5e-da69-435d-b416-d447f6666646 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:20.755212 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-61ca0d5e-da69-435d-b416-d447f6666646 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:20.755649 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-61ca0d5e-da69-435d-b416-d447f6666646 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:20.756351 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-61ca0d5e-da69-435d-b416-d447f6666646 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:20.756795 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-61ca0d5e-da69-435d-b416-d447f6666646 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:20.757212 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-61ca0d5e-da69-435d-b416-d447f6666646 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:20.890939 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-b29af78a-0ba9-4d3a-8637-47201d8d2a4e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:20.897104 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-61ca0d5e-da69-435d-b416-d447f6666646 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:20.899386 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-b29af78a-0ba9-4d3a-8637-47201d8d2a4e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1677 microversion: 2.1 time: 0.161931 Aug 09 18:52:20.899965 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 220/453] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:52:20 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:52:20.905065 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-61ca0d5e-da69-435d-b416-d447f6666646 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252" status: 200 len: 1365 microversion: 2.1 time: 0.164651 Aug 09 18:52:20.905884 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 234/454] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:52:20 2022] GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:52:21.920307 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-50b09c30-153e-4105-85ad-faf4ba3334cc tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:21.921022 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-50b09c30-153e-4105-85ad-faf4ba3334cc tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:21.926671 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-701b7f48-81ad-48ad-beb4-5be52f29ced7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:21.927281 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-701b7f48-81ad-48ad-beb4-5be52f29ced7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 6ba05bdf-8754-4e31-976a-816a4485a252] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:21.927840 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-50b09c30-153e-4105-85ad-faf4ba3334cc tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:21.928325 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-50b09c30-153e-4105-85ad-faf4ba3334cc tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:21.928761 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-50b09c30-153e-4105-85ad-faf4ba3334cc tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:21.929453 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-50b09c30-153e-4105-85ad-faf4ba3334cc tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:21.929935 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-50b09c30-153e-4105-85ad-faf4ba3334cc tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:21.930359 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-50b09c30-153e-4105-85ad-faf4ba3334cc tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:21.933602 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-701b7f48-81ad-48ad-beb4-5be52f29ced7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:21.934087 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-701b7f48-81ad-48ad-beb4-5be52f29ced7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:21.934523 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-701b7f48-81ad-48ad-beb4-5be52f29ced7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:21.935215 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-701b7f48-81ad-48ad-beb4-5be52f29ced7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:21.935669 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-701b7f48-81ad-48ad-beb4-5be52f29ced7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:21.936094 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-701b7f48-81ad-48ad-beb4-5be52f29ced7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:22.066060 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-701b7f48-81ad-48ad-beb4-5be52f29ced7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:22.066365 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-50b09c30-153e-4105-85ad-faf4ba3334cc tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:22.073516 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-701b7f48-81ad-48ad-beb4-5be52f29ced7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252" status: 200 len: 1556 microversion: 2.1 time: 0.150958 Aug 09 18:52:22.073945 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-50b09c30-153e-4105-85ad-faf4ba3334cc tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1677 microversion: 2.1 time: 0.157444 Aug 09 18:52:22.074143 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 235/455] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:52:21 2022] GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252 => generated 1556 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:52:22.074506 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 221/456] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:52:21 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:52:22.095315 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-52d89196-70a0-49eb-a896-1a4b6c394bb7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:22.095809 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-52d89196-70a0-49eb-a896-1a4b6c394bb7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 6ba05bdf-8754-4e31-976a-816a4485a252] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:22.102608 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-52d89196-70a0-49eb-a896-1a4b6c394bb7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:22.103089 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-52d89196-70a0-49eb-a896-1a4b6c394bb7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:22.103682 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-52d89196-70a0-49eb-a896-1a4b6c394bb7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:22.104516 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-52d89196-70a0-49eb-a896-1a4b6c394bb7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:22.104974 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-52d89196-70a0-49eb-a896-1a4b6c394bb7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:22.105396 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-52d89196-70a0-49eb-a896-1a4b6c394bb7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:22.185630 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-52d89196-70a0-49eb-a896-1a4b6c394bb7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094949 Aug 09 18:52:22.186226 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 236/457] 10.222.0.57 () {58 vars in 1275 bytes} [Tue Aug 9 18:52:22 2022] GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:52:23.096404 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-5dd5c771-943d-4f04-af68-c6daddbb746f tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:23.097038 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-5dd5c771-943d-4f04-af68-c6daddbb746f tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:23.104052 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5dd5c771-943d-4f04-af68-c6daddbb746f tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:23.104548 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5dd5c771-943d-4f04-af68-c6daddbb746f tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:23.104981 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5dd5c771-943d-4f04-af68-c6daddbb746f tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:23.105723 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5dd5c771-943d-4f04-af68-c6daddbb746f tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:23.106180 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5dd5c771-943d-4f04-af68-c6daddbb746f tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:23.106652 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5dd5c771-943d-4f04-af68-c6daddbb746f tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:23.226347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-3cdefd87-8d06-48da-8215-5b971650a563 req-c97ed0fe-cd7e-4af0-bd4d-626e5f6a9fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ba05bdf-8754-4e31-976a-816a4485a252", "tag": "43d43174-05ce-4aa4-847d-a37146ed16a3"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:52:23.239862 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-3cdefd87-8d06-48da-8215-5b971650a563 req-c97ed0fe-cd7e-4af0-bd4d-626e5f6a9fb1 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:23.240350 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-3cdefd87-8d06-48da-8215-5b971650a563 req-c97ed0fe-cd7e-4af0-bd4d-626e5f6a9fb1 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:23.240778 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-3cdefd87-8d06-48da-8215-5b971650a563 req-c97ed0fe-cd7e-4af0-bd4d-626e5f6a9fb1 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:23.269208 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-5dd5c771-943d-4f04-af68-c6daddbb746f tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:23.272325 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-3cdefd87-8d06-48da-8215-5b971650a563 req-c97ed0fe-cd7e-4af0-bd4d-626e5f6a9fb1 service nova] Creating event network-changed:43d43174-05ce-4aa4-847d-a37146ed16a3 for instance 6ba05bdf-8754-4e31-976a-816a4485a252 on hv-cinder-82660 Aug 09 18:52:23.278181 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-3cdefd87-8d06-48da-8215-5b971650a563 req-c97ed0fe-cd7e-4af0-bd4d-626e5f6a9fb1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055944 Aug 09 18:52:23.278990 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 237/458] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:52:23.279557 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-5dd5c771-943d-4f04-af68-c6daddbb746f tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1677 microversion: 2.1 time: 0.187281 Aug 09 18:52:23.280374 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 222/459] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:52:23 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1677 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:52:24.306175 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f2f1f689-441e-44cd-ab3c-214ac98680d0 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:24.306882 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-f2f1f689-441e-44cd-ab3c-214ac98680d0 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:24.314018 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f2f1f689-441e-44cd-ab3c-214ac98680d0 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:24.314773 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f2f1f689-441e-44cd-ab3c-214ac98680d0 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:24.315206 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f2f1f689-441e-44cd-ab3c-214ac98680d0 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:24.315912 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f2f1f689-441e-44cd-ab3c-214ac98680d0 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:24.316363 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f2f1f689-441e-44cd-ab3c-214ac98680d0 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:24.316784 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f2f1f689-441e-44cd-ab3c-214ac98680d0 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:24.455541 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f2f1f689-441e-44cd-ab3c-214ac98680d0 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:24.463127 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f2f1f689-441e-44cd-ab3c-214ac98680d0 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1677 microversion: 2.1 time: 0.162195 Aug 09 18:52:24.463688 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 238/460] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:52:24 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:52:25.484264 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-7ae340e7-3a82-4ed2-9d18-d73c777141f2 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:25.484869 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-7ae340e7-3a82-4ed2-9d18-d73c777141f2 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:25.487896 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_api:SELECT=42 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:52:25.492557 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7ae340e7-3a82-4ed2-9d18-d73c777141f2 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:25.493034 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7ae340e7-3a82-4ed2-9d18-d73c777141f2 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:25.493468 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7ae340e7-3a82-4ed2-9d18-d73c777141f2 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:25.494179 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7ae340e7-3a82-4ed2-9d18-d73c777141f2 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:25.494630 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7ae340e7-3a82-4ed2-9d18-d73c777141f2 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:25.508651 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7ae340e7-3a82-4ed2-9d18-d73c777141f2 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:25.621758 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-7ae340e7-3a82-4ed2-9d18-d73c777141f2 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:25.629723 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-7ae340e7-3a82-4ed2-9d18-d73c777141f2 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1677 microversion: 2.1 time: 0.149308 Aug 09 18:52:25.630293 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 223/461] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:52:25 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:52:26.650927 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5812b9f6-8efa-461a-b46c-11df06ba08f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:26.651540 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-5812b9f6-8efa-461a-b46c-11df06ba08f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:26.658006 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5812b9f6-8efa-461a-b46c-11df06ba08f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:26.658486 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5812b9f6-8efa-461a-b46c-11df06ba08f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:26.658920 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5812b9f6-8efa-461a-b46c-11df06ba08f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:26.659609 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5812b9f6-8efa-461a-b46c-11df06ba08f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:26.660062 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5812b9f6-8efa-461a-b46c-11df06ba08f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:26.660486 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5812b9f6-8efa-461a-b46c-11df06ba08f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:26.787739 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5812b9f6-8efa-461a-b46c-11df06ba08f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:26.795096 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-5812b9f6-8efa-461a-b46c-11df06ba08f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1677 microversion: 2.1 time: 0.148128 Aug 09 18:52:26.795696 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 239/462] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:52:26 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:52:27.816574 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-794b4431-6dce-4da8-ad96-75c356581fad tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:27.817168 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-794b4431-6dce-4da8-ad96-75c356581fad tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:27.823582 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-794b4431-6dce-4da8-ad96-75c356581fad tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:27.824058 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-794b4431-6dce-4da8-ad96-75c356581fad tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:27.824486 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-794b4431-6dce-4da8-ad96-75c356581fad tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:27.825164 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-794b4431-6dce-4da8-ad96-75c356581fad tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:27.825643 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-794b4431-6dce-4da8-ad96-75c356581fad tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:27.826063 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-794b4431-6dce-4da8-ad96-75c356581fad tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:27.959586 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-794b4431-6dce-4da8-ad96-75c356581fad tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:27.967181 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-794b4431-6dce-4da8-ad96-75c356581fad tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1677 microversion: 2.1 time: 0.154534 Aug 09 18:52:27.967752 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 224/463] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:52:27 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:52:28.988478 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-31603088-c644-40f3-8692-5a12e21ee041 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:28.989083 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-31603088-c644-40f3-8692-5a12e21ee041 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:28.995856 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-31603088-c644-40f3-8692-5a12e21ee041 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:28.996336 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-31603088-c644-40f3-8692-5a12e21ee041 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:28.996770 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-31603088-c644-40f3-8692-5a12e21ee041 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:28.997457 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-31603088-c644-40f3-8692-5a12e21ee041 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:28.997935 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-31603088-c644-40f3-8692-5a12e21ee041 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:28.998359 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-31603088-c644-40f3-8692-5a12e21ee041 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:29.019501 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:52:29.134236 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-31603088-c644-40f3-8692-5a12e21ee041 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:29.141571 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-31603088-c644-40f3-8692-5a12e21ee041 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1677 microversion: 2.1 time: 0.157314 Aug 09 18:52:29.142138 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 240/464] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:52:28 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:52:30.163981 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-f08e3cdf-f15c-4a7c-8760-10be663df92d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:30.164564 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-f08e3cdf-f15c-4a7c-8760-10be663df92d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:30.171204 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f08e3cdf-f15c-4a7c-8760-10be663df92d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:30.171681 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f08e3cdf-f15c-4a7c-8760-10be663df92d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:30.172108 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f08e3cdf-f15c-4a7c-8760-10be663df92d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:30.172794 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f08e3cdf-f15c-4a7c-8760-10be663df92d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:30.173238 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f08e3cdf-f15c-4a7c-8760-10be663df92d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:30.173679 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f08e3cdf-f15c-4a7c-8760-10be663df92d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:30.319996 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-f08e3cdf-f15c-4a7c-8760-10be663df92d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:30.327599 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-f08e3cdf-f15c-4a7c-8760-10be663df92d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1677 microversion: 2.1 time: 0.168141 Aug 09 18:52:30.328177 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 225/465] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:52:30 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:52:31.348252 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-67c47630-79d8-4a28-bd52-2eb1f3fb4b03 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:31.348895 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-67c47630-79d8-4a28-bd52-2eb1f3fb4b03 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:31.356809 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-67c47630-79d8-4a28-bd52-2eb1f3fb4b03 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:31.357306 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-67c47630-79d8-4a28-bd52-2eb1f3fb4b03 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:31.357784 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-67c47630-79d8-4a28-bd52-2eb1f3fb4b03 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:31.358510 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-67c47630-79d8-4a28-bd52-2eb1f3fb4b03 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:31.358963 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-67c47630-79d8-4a28-bd52-2eb1f3fb4b03 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:31.359426 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-67c47630-79d8-4a28-bd52-2eb1f3fb4b03 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:31.490123 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-67c47630-79d8-4a28-bd52-2eb1f3fb4b03 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:31.497510 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-67c47630-79d8-4a28-bd52-2eb1f3fb4b03 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1654 microversion: 2.1 time: 0.153215 Aug 09 18:52:31.498103 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 241/466] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:52:31 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1654 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:52:31.517649 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-fd18ea2a-4cf8-43a9-8416-0cbe73b7f714 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:52:31.524694 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fd18ea2a-4cf8-43a9-8416-0cbe73b7f714 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:31.527246 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fd18ea2a-4cf8-43a9-8416-0cbe73b7f714 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:31.527246 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fd18ea2a-4cf8-43a9-8416-0cbe73b7f714 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:31.547900 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-fd18ea2a-4cf8-43a9-8416-0cbe73b7f714 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Going to try to start instance {{(pid=124726) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 09 18:52:31.753087 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-fd18ea2a-4cf8-43a9-8416-0cbe73b7f714 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "POST /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af/action" status: 202 len: 0 microversion: 2.1 time: 0.238965 Aug 09 18:52:31.753648 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 226/467] 10.222.0.57 () {60 vars in 1278 bytes} [Tue Aug 9 18:52:31 2022] POST /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:52:31.761775 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b3cedf94-9713-484b-b208-c40730d434af tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:31.762390 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-b3cedf94-9713-484b-b208-c40730d434af tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:31.768282 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b3cedf94-9713-484b-b208-c40730d434af tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:31.768766 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b3cedf94-9713-484b-b208-c40730d434af tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:31.769202 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b3cedf94-9713-484b-b208-c40730d434af tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:31.769927 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b3cedf94-9713-484b-b208-c40730d434af tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:31.770379 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b3cedf94-9713-484b-b208-c40730d434af tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:31.770808 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b3cedf94-9713-484b-b208-c40730d434af tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:31.903524 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-b3cedf94-9713-484b-b208-c40730d434af tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:31.910369 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-b3cedf94-9713-484b-b208-c40730d434af tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1663 microversion: 2.1 time: 0.152441 Aug 09 18:52:31.911262 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 242/468] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:52:31 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1663 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:52:32.933738 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-7a51dbfd-a417-44e8-a3ac-add39e7053c0 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:32.934436 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-7a51dbfd-a417-44e8-a3ac-add39e7053c0 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:32.940552 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7a51dbfd-a417-44e8-a3ac-add39e7053c0 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:32.941033 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7a51dbfd-a417-44e8-a3ac-add39e7053c0 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:32.941469 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7a51dbfd-a417-44e8-a3ac-add39e7053c0 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:32.942199 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7a51dbfd-a417-44e8-a3ac-add39e7053c0 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:32.942681 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7a51dbfd-a417-44e8-a3ac-add39e7053c0 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:32.943140 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7a51dbfd-a417-44e8-a3ac-add39e7053c0 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:33.076610 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-7a51dbfd-a417-44e8-a3ac-add39e7053c0 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:33.084756 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-7a51dbfd-a417-44e8-a3ac-add39e7053c0 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1663 microversion: 2.1 time: 0.155810 Aug 09 18:52:33.085317 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 227/469] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:52:32 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1663 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:52:34.105755 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-ac062865-8aec-45c9-b9c2-e21c44019ef1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:34.106369 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-ac062865-8aec-45c9-b9c2-e21c44019ef1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:34.112771 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ac062865-8aec-45c9-b9c2-e21c44019ef1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:34.113257 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ac062865-8aec-45c9-b9c2-e21c44019ef1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:34.113725 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ac062865-8aec-45c9-b9c2-e21c44019ef1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:34.114422 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ac062865-8aec-45c9-b9c2-e21c44019ef1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:34.114913 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ac062865-8aec-45c9-b9c2-e21c44019ef1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:34.115335 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ac062865-8aec-45c9-b9c2-e21c44019ef1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:34.247203 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-ac062865-8aec-45c9-b9c2-e21c44019ef1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:34.254710 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-ac062865-8aec-45c9-b9c2-e21c44019ef1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1667 microversion: 2.1 time: 0.152863 Aug 09 18:52:34.255286 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 243/470] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:52:34 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1667 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:52:44.561861 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-d33d87a7-e463-4c9c-a252-1d7de74079d3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33655ffe-0c8d-447b-bf46-cc9509cd41ba"}} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:52:44.564293 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-d33d87a7-e463-4c9c-a252-1d7de74079d3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:44.566532 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_api:SELECT=9 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:52:44.567325 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell1:SELECT=72,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:52:44.571932 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d33d87a7-e463-4c9c-a252-1d7de74079d3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:44.572417 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d33d87a7-e463-4c9c-a252-1d7de74079d3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:44.572852 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d33d87a7-e463-4c9c-a252-1d7de74079d3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:44.573616 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d33d87a7-e463-4c9c-a252-1d7de74079d3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:44.574063 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d33d87a7-e463-4c9c-a252-1d7de74079d3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:44.574531 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d33d87a7-e463-4c9c-a252-1d7de74079d3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:45.299650 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-d33d87a7-e463-4c9c-a252-1d7de74079d3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "POST /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.741823 Aug 09 18:52:45.300376 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 228/471] 10.222.0.57 () {60 vars in 1323 bytes} [Tue Aug 9 18:52:44 2022] POST /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2/os-volume_attachments => generated 194 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:52:51.402027 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-beb3b47b-c6be-4f43-9ef6-3f9bcf662db7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:51.402547 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-beb3b47b-c6be-4f43-9ef6-3f9bcf662db7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:51.404658 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=35 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:52:51.405306 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=20 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:52:51.410075 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-beb3b47b-c6be-4f43-9ef6-3f9bcf662db7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:51.410551 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-beb3b47b-c6be-4f43-9ef6-3f9bcf662db7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:51.410976 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-beb3b47b-c6be-4f43-9ef6-3f9bcf662db7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:51.411658 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-beb3b47b-c6be-4f43-9ef6-3f9bcf662db7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:51.412101 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-beb3b47b-c6be-4f43-9ef6-3f9bcf662db7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:51.412516 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-beb3b47b-c6be-4f43-9ef6-3f9bcf662db7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:51.442764 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-beb3b47b-c6be-4f43-9ef6-3f9bcf662db7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd/os-volume_attachments/3590a6e4-9add-4d68-9e7e-b475a80c97df" status: 200 len: 194 microversion: 2.20 time: 0.045496 Aug 09 18:52:51.443388 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 244/472] 10.222.0.57 () {60 vars in 1454 bytes} [Tue Aug 9 18:52:51 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd/os-volume_attachments/3590a6e4-9add-4d68-9e7e-b475a80c97df => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:52:51.513141 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-d6c725fd-dcb2-4de1-844a-7ab23e384f15 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:51.513758 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-d6c725fd-dcb2-4de1-844a-7ab23e384f15 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:51.519854 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d6c725fd-dcb2-4de1-844a-7ab23e384f15 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:51.520272 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d6c725fd-dcb2-4de1-844a-7ab23e384f15 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:51.520703 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d6c725fd-dcb2-4de1-844a-7ab23e384f15 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:51.521384 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d6c725fd-dcb2-4de1-844a-7ab23e384f15 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:51.521860 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d6c725fd-dcb2-4de1-844a-7ab23e384f15 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:51.522283 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d6c725fd-dcb2-4de1-844a-7ab23e384f15 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:51.601757 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.objects.instance [None req-d6c725fd-dcb2-4de1-844a-7ab23e384f15 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lazy-loading 'services' on Instance uuid 22aac118-db08-4aca-a5e7-3f2cad5e49fd {{(pid=124726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:52:51.807480 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-d6c725fd-dcb2-4de1-844a-7ab23e384f15 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "DELETE /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd/os-volume_attachments/3590a6e4-9add-4d68-9e7e-b475a80c97df" status: 202 len: 0 microversion: 2.20 time: 0.299430 Aug 09 18:52:51.808097 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 229/473] 10.222.0.57 () {60 vars in 1457 bytes} [Tue Aug 9 18:52:51 2022] DELETE /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd/os-volume_attachments/3590a6e4-9add-4d68-9e7e-b475a80c97df => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:52:51.816981 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d056f0af-a3ff-41de-aee3-8a34ad9092a1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:51.819155 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-d056f0af-a3ff-41de-aee3-8a34ad9092a1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:51.826407 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d056f0af-a3ff-41de-aee3-8a34ad9092a1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:51.826902 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d056f0af-a3ff-41de-aee3-8a34ad9092a1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:51.827340 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d056f0af-a3ff-41de-aee3-8a34ad9092a1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:51.828038 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d056f0af-a3ff-41de-aee3-8a34ad9092a1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:51.828519 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d056f0af-a3ff-41de-aee3-8a34ad9092a1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:51.828936 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d056f0af-a3ff-41de-aee3-8a34ad9092a1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:51.860807 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-d056f0af-a3ff-41de-aee3-8a34ad9092a1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048155 Aug 09 18:52:51.861377 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 245/474] 10.222.0.57 () {60 vars in 1343 bytes} [Tue Aug 9 18:52:51 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:52:52.838343 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-f94218a7-7c18-4c34-a026-61ea4150b9b1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:52:52.840816 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-f94218a7-7c18-4c34-a026-61ea4150b9b1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:52.847159 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f94218a7-7c18-4c34-a026-61ea4150b9b1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:52.847641 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f94218a7-7c18-4c34-a026-61ea4150b9b1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:52.848068 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f94218a7-7c18-4c34-a026-61ea4150b9b1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:52.848758 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f94218a7-7c18-4c34-a026-61ea4150b9b1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:52.849210 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f94218a7-7c18-4c34-a026-61ea4150b9b1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:52.849664 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f94218a7-7c18-4c34-a026-61ea4150b9b1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:52.873279 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.objects.instance [None req-f94218a7-7c18-4c34-a026-61ea4150b9b1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lazy-loading 'flavor' on Instance uuid e15bc2b4-4702-4ee5-9483-87db30954da2 {{(pid=124726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:52:52.873553 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-cda6c08b-c967-4628-8fdb-d73adc6dd029 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:52.875544 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-cda6c08b-c967-4628-8fdb-d73adc6dd029 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:52.881942 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cda6c08b-c967-4628-8fdb-d73adc6dd029 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:52.882430 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cda6c08b-c967-4628-8fdb-d73adc6dd029 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:52.883479 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cda6c08b-c967-4628-8fdb-d73adc6dd029 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:52.884186 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cda6c08b-c967-4628-8fdb-d73adc6dd029 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:52.884647 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cda6c08b-c967-4628-8fdb-d73adc6dd029 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:52.885070 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cda6c08b-c967-4628-8fdb-d73adc6dd029 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:52.915971 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-cda6c08b-c967-4628-8fdb-d73adc6dd029 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046626 Aug 09 18:52:52.916534 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 246/475] 10.222.0.57 () {60 vars in 1343 bytes} [Tue Aug 9 18:52:52 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 18:52:53.225644 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-f94218a7-7c18-4c34-a026-61ea4150b9b1 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "POST /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2/action" status: 200 len: 32 microversion: 2.1 time: 0.393087 Aug 09 18:52:53.226328 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 230/476] 10.222.0.57 () {60 vars in 1278 bytes} [Tue Aug 9 18:52:52 2022] POST /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2/action => generated 32 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 18:52:53.235714 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-ae04957e-e15b-482f-9320-1218d849d4bc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:53.240221 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-ae04957e-e15b-482f-9320-1218d849d4bc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:53.243189 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ae04957e-e15b-482f-9320-1218d849d4bc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:53.243659 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ae04957e-e15b-482f-9320-1218d849d4bc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:53.244089 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ae04957e-e15b-482f-9320-1218d849d4bc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:53.244772 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ae04957e-e15b-482f-9320-1218d849d4bc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:53.245215 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ae04957e-e15b-482f-9320-1218d849d4bc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:53.245656 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ae04957e-e15b-482f-9320-1218d849d4bc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:53.410041 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-ae04957e-e15b-482f-9320-1218d849d4bc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:53.419471 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-ae04957e-e15b-482f-9320-1218d849d4bc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2" status: 200 len: 1736 microversion: 2.1 time: 0.187634 Aug 09 18:52:53.420059 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 247/477] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:52:53 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2 => generated 1736 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:52:53.930085 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-9b7305e4-5428-4e80-b20f-ac966d3575c5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:53.932304 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-9b7305e4-5428-4e80-b20f-ac966d3575c5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:53.938394 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9b7305e4-5428-4e80-b20f-ac966d3575c5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:53.938873 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9b7305e4-5428-4e80-b20f-ac966d3575c5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:53.939305 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9b7305e4-5428-4e80-b20f-ac966d3575c5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:53.939992 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9b7305e4-5428-4e80-b20f-ac966d3575c5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:53.940439 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9b7305e4-5428-4e80-b20f-ac966d3575c5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:53.940859 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9b7305e4-5428-4e80-b20f-ac966d3575c5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:53.973544 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-9b7305e4-5428-4e80-b20f-ac966d3575c5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048816 Aug 09 18:52:53.979366 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 231/478] 10.222.0.57 () {60 vars in 1343 bytes} [Tue Aug 9 18:52:53 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:52:54.036712 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-6eb41ee2-bd10-4668-aeb4-e11c432a989a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:54.037327 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-6eb41ee2-bd10-4668-aeb4-e11c432a989a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:54.044064 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6eb41ee2-bd10-4668-aeb4-e11c432a989a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:54.044517 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6eb41ee2-bd10-4668-aeb4-e11c432a989a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:54.044955 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6eb41ee2-bd10-4668-aeb4-e11c432a989a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:54.045690 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6eb41ee2-bd10-4668-aeb4-e11c432a989a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:54.046150 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6eb41ee2-bd10-4668-aeb4-e11c432a989a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:54.046622 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6eb41ee2-bd10-4668-aeb4-e11c432a989a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:54.074949 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-6eb41ee2-bd10-4668-aeb4-e11c432a989a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Going to try to terminate instance {{(pid=124725) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:52:54.410599 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-6eb41ee2-bd10-4668-aeb4-e11c432a989a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "DELETE /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 204 len: 0 microversion: 2.20 time: 0.377465 Aug 09 18:52:54.411188 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 248/479] 10.222.0.57 () {60 vars in 1280 bytes} [Tue Aug 9 18:52:54 2022] DELETE /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 18:52:54.420092 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-6651ee39-96c7-4848-89d3-a5349c0c83e8 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:54.420821 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-6651ee39-96c7-4848-89d3-a5349c0c83e8 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:54.426876 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6651ee39-96c7-4848-89d3-a5349c0c83e8 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:54.427352 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6651ee39-96c7-4848-89d3-a5349c0c83e8 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:54.428048 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6651ee39-96c7-4848-89d3-a5349c0c83e8 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:54.428731 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6651ee39-96c7-4848-89d3-a5349c0c83e8 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:54.429181 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6651ee39-96c7-4848-89d3-a5349c0c83e8 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:54.430219 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6651ee39-96c7-4848-89d3-a5349c0c83e8 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:54.442420 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-524c34c4-ad56-4d7b-8cb8-1d0b5b899c78 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:54.443110 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-524c34c4-ad56-4d7b-8cb8-1d0b5b899c78 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:54.449017 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-524c34c4-ad56-4d7b-8cb8-1d0b5b899c78 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:54.449659 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-524c34c4-ad56-4d7b-8cb8-1d0b5b899c78 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:54.450095 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-524c34c4-ad56-4d7b-8cb8-1d0b5b899c78 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:54.450788 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-524c34c4-ad56-4d7b-8cb8-1d0b5b899c78 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:54.451236 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-524c34c4-ad56-4d7b-8cb8-1d0b5b899c78 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:54.451656 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-524c34c4-ad56-4d7b-8cb8-1d0b5b899c78 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:54.591749 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-6651ee39-96c7-4848-89d3-a5349c0c83e8 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:54.599650 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-6651ee39-96c7-4848-89d3-a5349c0c83e8 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:54.601143 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-6651ee39-96c7-4848-89d3-a5349c0c83e8 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:54.602552 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-6651ee39-96c7-4848-89d3-a5349c0c83e8 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1722 microversion: 2.20 time: 0.186491 Aug 09 18:52:54.603111 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 232/480] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:52:54 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:52:54.611960 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-524c34c4-ad56-4d7b-8cb8-1d0b5b899c78 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:54.620435 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-524c34c4-ad56-4d7b-8cb8-1d0b5b899c78 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2" status: 200 len: 1736 microversion: 2.1 time: 0.182252 Aug 09 18:52:54.621213 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 249/481] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:52:54 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2 => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:52:55.628463 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-c472bd7c-113c-4ba1-8ff9-09dd1f48c793 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:55.629066 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-c472bd7c-113c-4ba1-8ff9-09dd1f48c793 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:55.635763 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c472bd7c-113c-4ba1-8ff9-09dd1f48c793 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:55.636244 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c472bd7c-113c-4ba1-8ff9-09dd1f48c793 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:55.636756 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c472bd7c-113c-4ba1-8ff9-09dd1f48c793 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:55.637455 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c472bd7c-113c-4ba1-8ff9-09dd1f48c793 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:55.637931 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c472bd7c-113c-4ba1-8ff9-09dd1f48c793 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:55.638353 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c472bd7c-113c-4ba1-8ff9-09dd1f48c793 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:55.642086 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d63d57aa-712d-4071-987d-1eded7230e32 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:55.642696 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-d63d57aa-712d-4071-987d-1eded7230e32 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:55.649707 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d63d57aa-712d-4071-987d-1eded7230e32 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:55.650198 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d63d57aa-712d-4071-987d-1eded7230e32 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:55.650633 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d63d57aa-712d-4071-987d-1eded7230e32 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:55.651335 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d63d57aa-712d-4071-987d-1eded7230e32 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:55.651792 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d63d57aa-712d-4071-987d-1eded7230e32 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:55.652219 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d63d57aa-712d-4071-987d-1eded7230e32 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:55.774214 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-c472bd7c-113c-4ba1-8ff9-09dd1f48c793 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:55.782706 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-c472bd7c-113c-4ba1-8ff9-09dd1f48c793 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:55.784195 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-c472bd7c-113c-4ba1-8ff9-09dd1f48c793 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:55.784699 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d63d57aa-712d-4071-987d-1eded7230e32 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:55.785365 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-c472bd7c-113c-4ba1-8ff9-09dd1f48c793 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1722 microversion: 2.20 time: 0.161048 Aug 09 18:52:55.785930 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 233/482] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:52:55 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:52:55.793426 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-d63d57aa-712d-4071-987d-1eded7230e32 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2" status: 200 len: 1736 microversion: 2.1 time: 0.155434 Aug 09 18:52:55.794018 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 250/483] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:52:55 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:52:56.811032 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-8dc18e69-1b7a-4667-b55f-3ba802d9ff32 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:56.811641 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-8dc18e69-1b7a-4667-b55f-3ba802d9ff32 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:56.814528 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f34e05df-7410-4856-aedc-2b2f771f7d9f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:56.815964 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-f34e05df-7410-4856-aedc-2b2f771f7d9f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:56.818510 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-8dc18e69-1b7a-4667-b55f-3ba802d9ff32 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:56.822741 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-8dc18e69-1b7a-4667-b55f-3ba802d9ff32 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:56.822741 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-8dc18e69-1b7a-4667-b55f-3ba802d9ff32 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:56.822741 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-8dc18e69-1b7a-4667-b55f-3ba802d9ff32 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:56.822741 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-8dc18e69-1b7a-4667-b55f-3ba802d9ff32 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:56.823056 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-8dc18e69-1b7a-4667-b55f-3ba802d9ff32 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:56.823144 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f34e05df-7410-4856-aedc-2b2f771f7d9f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:56.823144 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f34e05df-7410-4856-aedc-2b2f771f7d9f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:56.823466 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f34e05df-7410-4856-aedc-2b2f771f7d9f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:56.824350 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f34e05df-7410-4856-aedc-2b2f771f7d9f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:56.824804 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f34e05df-7410-4856-aedc-2b2f771f7d9f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:56.825393 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f34e05df-7410-4856-aedc-2b2f771f7d9f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:56.925275 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-8dc18e69-1b7a-4667-b55f-3ba802d9ff32 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:56.934246 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-8dc18e69-1b7a-4667-b55f-3ba802d9ff32 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:56.936170 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-8dc18e69-1b7a-4667-b55f-3ba802d9ff32 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:56.937461 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-8dc18e69-1b7a-4667-b55f-3ba802d9ff32 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1654 microversion: 2.20 time: 0.132857 Aug 09 18:52:56.938149 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 234/484] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:52:56 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1654 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:52:56.975405 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f34e05df-7410-4856-aedc-2b2f771f7d9f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:56.984664 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f34e05df-7410-4856-aedc-2b2f771f7d9f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2" status: 200 len: 1736 microversion: 2.1 time: 0.174067 Aug 09 18:52:56.985259 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 251/485] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:52:56 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:52:57.395139 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-263f73d3-139c-4401-a628-c6b73b449103 req-b0b5e5f0-f423-4326-ac11-9be7628f3c8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22aac118-db08-4aca-a5e7-3f2cad5e49fd", "name": "network-vif-deleted", "tag": "7a0b7c9e-84bf-4317-b8ea-f03780b0d3b2"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:52:57.405667 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-263f73d3-139c-4401-a628-c6b73b449103 req-b0b5e5f0-f423-4326-ac11-9be7628f3c8f service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:57.406048 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-263f73d3-139c-4401-a628-c6b73b449103 req-b0b5e5f0-f423-4326-ac11-9be7628f3c8f service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:57.406700 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-263f73d3-139c-4401-a628-c6b73b449103 req-b0b5e5f0-f423-4326-ac11-9be7628f3c8f service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:57.418182 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-263f73d3-139c-4401-a628-c6b73b449103 req-b0b5e5f0-f423-4326-ac11-9be7628f3c8f service nova] Creating event network-vif-deleted:7a0b7c9e-84bf-4317-b8ea-f03780b0d3b2 for instance 22aac118-db08-4aca-a5e7-3f2cad5e49fd on hv-cinder-82660 Aug 09 18:52:57.423400 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-263f73d3-139c-4401-a628-c6b73b449103 req-b0b5e5f0-f423-4326-ac11-9be7628f3c8f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031987 Aug 09 18:52:57.427995 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 235/486] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:52:57.960988 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-829e7d8d-e812-418a-b98a-3de5fc12003c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:57.961753 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-829e7d8d-e812-418a-b98a-3de5fc12003c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:57.969918 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-829e7d8d-e812-418a-b98a-3de5fc12003c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:57.974013 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-829e7d8d-e812-418a-b98a-3de5fc12003c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:57.974013 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-829e7d8d-e812-418a-b98a-3de5fc12003c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:57.974013 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-829e7d8d-e812-418a-b98a-3de5fc12003c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:57.974013 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-829e7d8d-e812-418a-b98a-3de5fc12003c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:57.974389 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-829e7d8d-e812-418a-b98a-3de5fc12003c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:58.005923 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-829e7d8d-e812-418a-b98a-3de5fc12003c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:58.006500 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-829e7d8d-e812-418a-b98a-3de5fc12003c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:58.007002 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-829e7d8d-e812-418a-b98a-3de5fc12003c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:58.007333 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-52017f7b-c32a-4109-a677-932b1ac2ebbc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:58.007784 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.objects.instance [None req-829e7d8d-e812-418a-b98a-3de5fc12003c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lazy-loading 'fault' on Instance uuid 22aac118-db08-4aca-a5e7-3f2cad5e49fd {{(pid=124725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:52:58.008764 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-52017f7b-c32a-4109-a677-932b1ac2ebbc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:58.014964 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-52017f7b-c32a-4109-a677-932b1ac2ebbc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:58.015641 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-52017f7b-c32a-4109-a677-932b1ac2ebbc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:58.016233 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-52017f7b-c32a-4109-a677-932b1ac2ebbc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:58.017126 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-52017f7b-c32a-4109-a677-932b1ac2ebbc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:58.018288 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-52017f7b-c32a-4109-a677-932b1ac2ebbc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:58.018900 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-52017f7b-c32a-4109-a677-932b1ac2ebbc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:58.056072 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-829e7d8d-e812-418a-b98a-3de5fc12003c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:58.071784 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-829e7d8d-e812-418a-b98a-3de5fc12003c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:58.073728 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-829e7d8d-e812-418a-b98a-3de5fc12003c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:58.075181 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-829e7d8d-e812-418a-b98a-3de5fc12003c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 200 len: 1369 microversion: 2.20 time: 0.118328 Aug 09 18:52:58.076368 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 252/487] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:52:57 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 1369 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:52:58.167770 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-52017f7b-c32a-4109-a677-932b1ac2ebbc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:58.175780 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-52017f7b-c32a-4109-a677-932b1ac2ebbc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2" status: 200 len: 1736 microversion: 2.1 time: 0.173456 Aug 09 18:52:58.176709 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 236/488] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:52:58 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:52:59.099039 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a8af21a2-09b5-40d1-b051-96c623c99ef2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:59.099573 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-a8af21a2-09b5-40d1-b051-96c623c99ef2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:59.108979 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a8af21a2-09b5-40d1-b051-96c623c99ef2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:59.109460 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a8af21a2-09b5-40d1-b051-96c623c99ef2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:59.109924 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a8af21a2-09b5-40d1-b051-96c623c99ef2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:59.110618 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a8af21a2-09b5-40d1-b051-96c623c99ef2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:59.111069 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a8af21a2-09b5-40d1-b051-96c623c99ef2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:59.111493 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a8af21a2-09b5-40d1-b051-96c623c99ef2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:59.124721 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-a8af21a2-09b5-40d1-b051-96c623c99ef2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] HTTP exception thrown: Instance 22aac118-db08-4aca-a5e7-3f2cad5e49fd could not be found. Aug 09 18:52:59.126418 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a8af21a2-09b5-40d1-b051-96c623c99ef2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Request method failure captured: Aug 09 18:52:59.126418 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: request: GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd HTTP/1.1 Aug 09 18:52:59.126418 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept: application/json Aug 09 18:52:59.126418 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Aug 09 18:52:59.126418 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Connection: close Aug 09 18:52:59.126418 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Length: 0 Aug 09 18:52:59.126418 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Type: application/json Aug 09 18:52:59.126418 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Host: 10.222.0.57 Aug 09 18:52:59.126418 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Aug 09 18:52:59.126418 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.11 Aug 09 18:52:59.126418 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABi8qwZ_ag6HOvV6VfPrxStvZ_C5D11u4WJJ35XK_AkKtvO85BcO7ol6twLBz-TrQeI0sjF484B2Jemv7dfj37zqEVUfS_DW_oQfHU0BVVt3muawsMgj4iXiiNusv1EFpM8BkaDG2fhDaUVNzI0WxBEqCQlTDlXGvGtMFC-Yt6_iG9BvUA Aug 09 18:52:59.126418 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Aug 09 18:52:59.126418 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Aug 09 18:52:59.126418 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Aug 09 18:52:59.126418 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Aug 09 18:52:59.126418 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 18:52:59.126418 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Aug 09 18:52:59.126418 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Aug 09 18:52:59.126418 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Id: 6d738e0a61184b4db58e2607d72cca0a Aug 09 18:52:59.126418 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1396215 Aug 09 18:52:59.126418 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Role: reader,member Aug 09 18:52:59.126418 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Roles: reader,member Aug 09 18:52:59.128052 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_6d738e0a61184b4db58e2607d72cca0a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6d738e0a61184b4db58e2607d72cca0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/6d738e0a61184b4db58e2607d72cca0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6d738e0a61184b4db58e2607d72cca0a"}]}] Aug 09 18:52:59.128052 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1396215 Aug 09 18:52:59.128052 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 6d738e0a61184b4db58e2607d72cca0a Aug 09 18:52:59.128052 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1396215 Aug 09 18:52:59.128052 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User: tempest-AttachVolumeShelveTestJSON-1396215-project Aug 09 18:52:59.128052 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Aug 09 18:52:59.128052 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Aug 09 18:52:59.128052 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Id: ef8af9fd9e844ca4be10caa880357a4f Aug 09 18:52:59.128052 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1396215-project Aug 09 18:52:59.128052 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: method: > Aug 09 18:52:59.128052 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: exception: Instance 22aac118-db08-4aca-a5e7-3f2cad5e49fd could not be found. Aug 09 18:52:59.128052 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: action_args: {'id': '22aac118-db08-4aca-a5e7-3f2cad5e49fd'} Aug 09 18:52:59.129006 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:52:59.129006 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:52:59.129006 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:52:59.129006 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:52:59.129006 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:52:59.129006 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:52:59.129006 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:52:59.129006 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:52:59.129006 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:52:59.129006 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:52:59.129006 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22aac118-db08-4aca-a5e7-3f2cad5e49fd could not be found. Aug 09 18:52:59.129006 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:52:59.129006 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:52:59.129006 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:52:59.129006 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:52:59.129006 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:52:59.129006 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:52:59.129006 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:52:59.129006 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:52:59.129006 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:52:59.130515 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:52:59.130515 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:52:59.130515 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:52:59.130515 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:52:59.130515 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:52:59.130515 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:52:59.130515 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:52:59.130515 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22aac118-db08-4aca-a5e7-3f2cad5e49fd could not be found. Aug 09 18:52:59.130515 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:52:59.130515 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:52:59.130515 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:52:59.130515 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:52:59.130515 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:52:59.130515 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:52:59.130515 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:52:59.130515 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:52:59.130515 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22aac118-db08-4aca-a5e7-3f2cad5e49fd could not be found. Aug 09 18:52:59.130515 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:52:59.131777 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a8af21a2-09b5-40d1-b051-96c623c99ef2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Returning 404 to user: Instance 22aac118-db08-4aca-a5e7-3f2cad5e49fd could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:52:59.131777 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-a8af21a2-09b5-40d1-b051-96c623c99ef2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 404 len: 111 microversion: 2.20 time: 0.032782 Aug 09 18:52:59.131777 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 253/489] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:52:59 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 18:52:59.137466 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-5454ac4e-40b5-4c1d-b9ca-2119f40e0c50 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '.version_select at 0x7f8d69c7f5e0>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:59.199647 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-721acb2d-7ee7-4ebf-8f40-bbd770c804be tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:52:59.200206 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-721acb2d-7ee7-4ebf-8f40-bbd770c804be tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:52:59.206409 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-721acb2d-7ee7-4ebf-8f40-bbd770c804be tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:59.206905 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-721acb2d-7ee7-4ebf-8f40-bbd770c804be tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:59.207339 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-721acb2d-7ee7-4ebf-8f40-bbd770c804be tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:59.208041 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-721acb2d-7ee7-4ebf-8f40-bbd770c804be tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:52:59.208494 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-721acb2d-7ee7-4ebf-8f40-bbd770c804be tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:52:59.208918 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-721acb2d-7ee7-4ebf-8f40-bbd770c804be tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:52:59.219787 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-5454ac4e-40b5-4c1d-b9ca-2119f40e0c50 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1491812523" status: 204 len: 0 microversion: 2.20 time: 0.086746 Aug 09 18:52:59.220364 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 237/490] 10.222.0.57 () {60 vars in 1262 bytes} [Tue Aug 9 18:52:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1491812523 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 18:52:59.403402 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-721acb2d-7ee7-4ebf-8f40-bbd770c804be tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:52:59.411528 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-721acb2d-7ee7-4ebf-8f40-bbd770c804be tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2" status: 200 len: 1736 microversion: 2.1 time: 0.216328 Aug 09 18:52:59.412098 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 254/491] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:52:59 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:53:00.129669 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-6a46fb7e-220d-4b05-883a-41f47ca9123b tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Action: 'create', calling method: .version_select at 0x7f8d69d4c700>, body: {"keypair": {"name": "tempest-keypair-1260628463", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJ93WsNLY5NKF/1q0pePyawx0QpxUmY9M1XbaFherp/g4LH4Y9u6ftXsJuMp8bdPuN7+4CXBhXXrV+1sQZ2zKDPb8bWGCpJTzJO4RkjQN/8EtzObRRLvfZ7QgOguRz+oA=="}} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:53:00.146279 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.quota [None req-6a46fb7e-220d-4b05-883a-41f47ca9123b tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Getting quotas for project 6d738e0a61184b4db58e2607d72cca0a. Resources: {'key_pairs'} {{(pid=124726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:53:00.150632 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.quota [None req-6a46fb7e-220d-4b05-883a-41f47ca9123b tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Getting quotas for user ef8af9fd9e844ca4be10caa880357a4f and project 6d738e0a61184b4db58e2607d72cca0a. Resources: {'key_pairs'} {{(pid=124726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:53:00.229364 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-6a46fb7e-220d-4b05-883a-41f47ca9123b tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.103548 Aug 09 18:53:00.230055 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 238/492] 10.222.0.57 () {62 vars in 1200 bytes} [Tue Aug 9 18:53:00 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 105 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 09 18:53:00.434017 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-850efed4-17cf-4349-b883-1b1b00f03167 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:00.434628 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-850efed4-17cf-4349-b883-1b1b00f03167 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:00.441044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-850efed4-17cf-4349-b883-1b1b00f03167 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:00.441548 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-850efed4-17cf-4349-b883-1b1b00f03167 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:00.441989 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-850efed4-17cf-4349-b883-1b1b00f03167 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:00.442691 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-850efed4-17cf-4349-b883-1b1b00f03167 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:00.443141 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-850efed4-17cf-4349-b883-1b1b00f03167 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:00.443566 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-850efed4-17cf-4349-b883-1b1b00f03167 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:00.581070 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-850efed4-17cf-4349-b883-1b1b00f03167 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:00.589920 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-850efed4-17cf-4349-b883-1b1b00f03167 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2" status: 200 len: 1736 microversion: 2.1 time: 0.160279 Aug 09 18:53:00.590427 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 255/493] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:00 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:01.613716 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-8a141574-1697-43fc-a83e-9fa77f393676 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:01.614791 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-8a141574-1697-43fc-a83e-9fa77f393676 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:01.624382 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-8a141574-1697-43fc-a83e-9fa77f393676 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:01.625158 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-8a141574-1697-43fc-a83e-9fa77f393676 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:01.625853 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-8a141574-1697-43fc-a83e-9fa77f393676 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:01.628342 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-8a141574-1697-43fc-a83e-9fa77f393676 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:01.628342 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-8a141574-1697-43fc-a83e-9fa77f393676 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:01.628638 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-8a141574-1697-43fc-a83e-9fa77f393676 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:01.871050 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-8a141574-1697-43fc-a83e-9fa77f393676 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:01.880912 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-8a141574-1697-43fc-a83e-9fa77f393676 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2" status: 200 len: 1736 microversion: 2.1 time: 0.273251 Aug 09 18:53:01.881517 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 239/494] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:01 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2 => generated 1736 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:02.653591 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-22076552-eea2-438c-9033-07d18c0d0a41 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-723472486", "imageRef": "124dd477-ccfa-4be3-9973-6b1f33b47df8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7320bb6e-9e62-43d8-9234-a6a50410e80e"}], "security_groups": [{"name": "tempest-securitygroup--1383052134"}], "key_name": "tempest-keypair-1260628463", "user_data": "}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:53:02.773179 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.network.neutron [None req-22076552-eea2-438c-9033-07d18c0d0a41 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] validate_networks() for [('7320bb6e-9e62-43d8-9234-a6a50410e80e', None, None, None, None, None)] {{(pid=124725) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:53:02.902777 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-92433b69-75c1-448f-9667-520fce4b1018 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:02.903395 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-92433b69-75c1-448f-9667-520fce4b1018 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:02.924396 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-92433b69-75c1-448f-9667-520fce4b1018 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:02.925075 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-92433b69-75c1-448f-9667-520fce4b1018 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:02.925709 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-92433b69-75c1-448f-9667-520fce4b1018 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:02.926202 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-92433b69-75c1-448f-9667-520fce4b1018 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:02.926659 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-92433b69-75c1-448f-9667-520fce4b1018 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:02.927083 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-92433b69-75c1-448f-9667-520fce4b1018 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:03.063113 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-92433b69-75c1-448f-9667-520fce4b1018 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:03.072958 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-92433b69-75c1-448f-9667-520fce4b1018 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2" status: 200 len: 1736 microversion: 2.1 time: 0.173875 Aug 09 18:53:03.082492 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 240/495] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:02 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2 => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:53:03.168731 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-22076552-eea2-438c-9033-07d18c0d0a41 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Flavor limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:53:03.169157 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-22076552-eea2-438c-9033-07d18c0d0a41 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Image limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:53:03.169657 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-22076552-eea2-438c-9033-07d18c0d0a41 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Flavor pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:53:03.170063 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-22076552-eea2-438c-9033-07d18c0d0a41 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Image pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:53:03.170515 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-22076552-eea2-438c-9033-07d18c0d0a41 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:53:03.181443 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-22076552-eea2-438c-9033-07d18c0d0a41 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:03.181946 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-22076552-eea2-438c-9033-07d18c0d0a41 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:03.182471 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-22076552-eea2-438c-9033-07d18c0d0a41 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:03.183255 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-22076552-eea2-438c-9033-07d18c0d0a41 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:03.183702 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-22076552-eea2-438c-9033-07d18c0d0a41 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:03.184142 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-22076552-eea2-438c-9033-07d18c0d0a41 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:03.201761 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-22076552-eea2-438c-9033-07d18c0d0a41 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Getting quotas for project 6d738e0a61184b4db58e2607d72cca0a. Resources: {'cores', 'ram', 'instances'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:53:03.206745 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-22076552-eea2-438c-9033-07d18c0d0a41 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Getting quotas for user ef8af9fd9e844ca4be10caa880357a4f and project 6d738e0a61184b4db58e2607d72cca0a. Resources: {'cores', 'ram', 'instances'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:53:03.219477 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-22076552-eea2-438c-9033-07d18c0d0a41 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Going to run 1 instances... {{(pid=124725) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:53:03.221740 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-22076552-eea2-438c-9033-07d18c0d0a41 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='124dd477-ccfa-4be3-9973-6b1f33b47df8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:53:03.395564 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-22076552-eea2-438c-9033-07d18c0d0a41 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.746335 Aug 09 18:53:03.396221 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 256/496] 10.222.0.57 () {62 vars in 1188 bytes} [Tue Aug 9 18:53:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 09 18:53:03.408696 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-e3ee3d8c-56d6-47cf-93a9-205a9aed9077 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:03.409693 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-e3ee3d8c-56d6-47cf-93a9-205a9aed9077 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:03.484898 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-e3ee3d8c-56d6-47cf-93a9-205a9aed9077 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:03.492405 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-e3ee3d8c-56d6-47cf-93a9-205a9aed9077 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:03.493936 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-e3ee3d8c-56d6-47cf-93a9-205a9aed9077 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:03.495067 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-e3ee3d8c-56d6-47cf-93a9-205a9aed9077 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1281 microversion: 2.20 time: 0.091244 Aug 09 18:53:03.495622 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 241/497] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:53:03 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1281 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:53:04.097061 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-89e9e6f1-7a54-410f-8995-bda14bf5259c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:04.097771 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-89e9e6f1-7a54-410f-8995-bda14bf5259c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:04.105575 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-89e9e6f1-7a54-410f-8995-bda14bf5259c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:04.106067 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-89e9e6f1-7a54-410f-8995-bda14bf5259c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:04.106499 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-89e9e6f1-7a54-410f-8995-bda14bf5259c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:04.107195 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-89e9e6f1-7a54-410f-8995-bda14bf5259c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:04.107643 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-89e9e6f1-7a54-410f-8995-bda14bf5259c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:04.108059 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-89e9e6f1-7a54-410f-8995-bda14bf5259c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:04.236327 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-89e9e6f1-7a54-410f-8995-bda14bf5259c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:04.244835 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-89e9e6f1-7a54-410f-8995-bda14bf5259c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2" status: 200 len: 1736 microversion: 2.1 time: 0.152356 Aug 09 18:53:04.245407 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 257/498] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:04 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:04.518160 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-0d8b2f4b-2925-4f73-be75-96c436c63bc7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:04.518715 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-0d8b2f4b-2925-4f73-be75-96c436c63bc7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:04.525597 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0d8b2f4b-2925-4f73-be75-96c436c63bc7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:04.526073 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0d8b2f4b-2925-4f73-be75-96c436c63bc7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:04.526503 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0d8b2f4b-2925-4f73-be75-96c436c63bc7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:04.527185 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0d8b2f4b-2925-4f73-be75-96c436c63bc7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:04.527632 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0d8b2f4b-2925-4f73-be75-96c436c63bc7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:04.528050 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0d8b2f4b-2925-4f73-be75-96c436c63bc7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:04.591572 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-0d8b2f4b-2925-4f73-be75-96c436c63bc7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:04.599535 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-0d8b2f4b-2925-4f73-be75-96c436c63bc7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:04.601018 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-0d8b2f4b-2925-4f73-be75-96c436c63bc7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:04.602689 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-0d8b2f4b-2925-4f73-be75-96c436c63bc7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1285 microversion: 2.20 time: 0.088601 Aug 09 18:53:04.603243 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 242/499] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:53:04 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:53:05.266727 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-138b5577-22c6-422b-945f-5e72cb21a353 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:05.267424 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-138b5577-22c6-422b-945f-5e72cb21a353 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:05.274496 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-138b5577-22c6-422b-945f-5e72cb21a353 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:05.278304 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-138b5577-22c6-422b-945f-5e72cb21a353 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:05.278304 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-138b5577-22c6-422b-945f-5e72cb21a353 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:05.278304 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-138b5577-22c6-422b-945f-5e72cb21a353 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:05.278304 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-138b5577-22c6-422b-945f-5e72cb21a353 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:05.279560 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-138b5577-22c6-422b-945f-5e72cb21a353 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:05.431783 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-138b5577-22c6-422b-945f-5e72cb21a353 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:05.440041 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-138b5577-22c6-422b-945f-5e72cb21a353 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2" status: 200 len: 1736 microversion: 2.1 time: 0.177780 Aug 09 18:53:05.440621 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 258/500] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:05 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2 => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:05.625077 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-c11d06d6-363f-49cf-8051-559f7bfe71a8 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:05.625771 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-c11d06d6-363f-49cf-8051-559f7bfe71a8 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:05.632762 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c11d06d6-363f-49cf-8051-559f7bfe71a8 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:05.633879 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c11d06d6-363f-49cf-8051-559f7bfe71a8 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:05.634361 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c11d06d6-363f-49cf-8051-559f7bfe71a8 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:05.635132 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c11d06d6-363f-49cf-8051-559f7bfe71a8 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:05.635707 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c11d06d6-363f-49cf-8051-559f7bfe71a8 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:05.636151 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c11d06d6-363f-49cf-8051-559f7bfe71a8 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:05.700946 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-c11d06d6-363f-49cf-8051-559f7bfe71a8 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:05.709029 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-c11d06d6-363f-49cf-8051-559f7bfe71a8 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:05.710550 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-c11d06d6-363f-49cf-8051-559f7bfe71a8 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:05.712406 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-c11d06d6-363f-49cf-8051-559f7bfe71a8 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1277 microversion: 2.20 time: 0.091568 Aug 09 18:53:05.712986 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 243/501] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:53:05 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1277 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:53:06.462337 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-769c5463-0a2c-4784-aec5-a7e6d3faddb3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:06.463114 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-769c5463-0a2c-4784-aec5-a7e6d3faddb3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:06.469492 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-769c5463-0a2c-4784-aec5-a7e6d3faddb3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:06.470011 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-769c5463-0a2c-4784-aec5-a7e6d3faddb3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:06.470445 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-769c5463-0a2c-4784-aec5-a7e6d3faddb3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:06.471147 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-769c5463-0a2c-4784-aec5-a7e6d3faddb3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:06.471605 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-769c5463-0a2c-4784-aec5-a7e6d3faddb3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:06.472030 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-769c5463-0a2c-4784-aec5-a7e6d3faddb3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:06.610369 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-769c5463-0a2c-4784-aec5-a7e6d3faddb3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:06.614454 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:53:06.619639 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-769c5463-0a2c-4784-aec5-a7e6d3faddb3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2" status: 200 len: 1736 microversion: 2.1 time: 0.161202 Aug 09 18:53:06.620226 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 259/502] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:06 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:06.735090 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-c04710d3-7086-4396-bfc1-3870bcabba0e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:06.735853 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-c04710d3-7086-4396-bfc1-3870bcabba0e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:06.743830 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c04710d3-7086-4396-bfc1-3870bcabba0e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:06.744313 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c04710d3-7086-4396-bfc1-3870bcabba0e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:06.747709 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c04710d3-7086-4396-bfc1-3870bcabba0e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:06.747709 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c04710d3-7086-4396-bfc1-3870bcabba0e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:06.747709 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c04710d3-7086-4396-bfc1-3870bcabba0e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:06.747709 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c04710d3-7086-4396-bfc1-3870bcabba0e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:06.750999 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:53:06.818326 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-583d0881-dc0a-4324-a52b-754098074e4c tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:06.818848 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-583d0881-dc0a-4324-a52b-754098074e4c tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 6ba05bdf-8754-4e31-976a-816a4485a252] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:06.830719 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-583d0881-dc0a-4324-a52b-754098074e4c tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:06.830719 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-583d0881-dc0a-4324-a52b-754098074e4c tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:06.830982 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-c04710d3-7086-4396-bfc1-3870bcabba0e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:06.831084 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-583d0881-dc0a-4324-a52b-754098074e4c tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:06.831084 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-583d0881-dc0a-4324-a52b-754098074e4c tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:06.831084 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-583d0881-dc0a-4324-a52b-754098074e4c tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:06.831084 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-583d0881-dc0a-4324-a52b-754098074e4c tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:06.835798 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-c04710d3-7086-4396-bfc1-3870bcabba0e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:06.837299 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-c04710d3-7086-4396-bfc1-3870bcabba0e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:06.838462 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-c04710d3-7086-4396-bfc1-3870bcabba0e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1333 microversion: 2.20 time: 0.107295 Aug 09 18:53:06.838999 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 244/503] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:53:06 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1333 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:53:06.864915 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-583d0881-dc0a-4324-a52b-754098074e4c tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252/ips" status: 200 len: 151 microversion: 2.1 time: 0.052247 Aug 09 18:53:06.865645 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 260/504] 10.222.0.57 () {58 vars in 1248 bytes} [Tue Aug 9 18:53:06 2022] GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252/ips => generated 151 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:53:06.879054 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-c1c35dcb-4833-49fb-867e-4744894bf1e2 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2cf52a0-1953-4673-b81d-9aa9a817484e"}} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:53:06.881677 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-c1c35dcb-4833-49fb-867e-4744894bf1e2 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 6ba05bdf-8754-4e31-976a-816a4485a252] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:06.889030 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c1c35dcb-4833-49fb-867e-4744894bf1e2 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:06.889515 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c1c35dcb-4833-49fb-867e-4744894bf1e2 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:06.889973 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c1c35dcb-4833-49fb-867e-4744894bf1e2 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:06.890673 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c1c35dcb-4833-49fb-867e-4744894bf1e2 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:06.891129 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c1c35dcb-4833-49fb-867e-4744894bf1e2 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:06.891551 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c1c35dcb-4833-49fb-867e-4744894bf1e2 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:06.988006 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.wsgi [None req-c1c35dcb-4833-49fb-867e-4744894bf1e2 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] HTTP exception thrown: Invalid volume: volume a2cf52a0-1953-4673-b81d-9aa9a817484e is already attached to instances: 743aafc6-1787-4c6e-be09-3b460a00d5e9 Aug 09 18:53:06.989770 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-c1c35dcb-4833-49fb-867e-4744894bf1e2 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Request method failure captured: Aug 09 18:53:06.989770 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: request: POST /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252/os-volume_attachments HTTP/1.1 Aug 09 18:53:06.989770 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept: application/json Aug 09 18:53:06.989770 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept-Encoding: identity Aug 09 18:53:06.989770 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Connection: close Aug 09 18:53:06.989770 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Length: 74 Aug 09 18:53:06.989770 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Type: application/json Aug 09 18:53:06.989770 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Host: 10.222.0.57 Aug 09 18:53:06.989770 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Openstack-System-Scope: None Aug 09 18:53:06.989770 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: User-Agent: python-urllib3/1.26.11 Aug 09 18:53:06.989770 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Auth-Token: gAAAAABi8qxu6GlCXsghs7mXHsJ6lMdriR0lCN6zx0jJtIVa-hoSSpRyn9kABjaS5Ya_Ocw2sU0SEZSB-MC5jyn7nC01Qf-R3Wxc4u_OmCKdxSmXeuRuDoxnEqYVjV6mxSKvywrengnzW8AvtzIMJfiluX7W9B1UousoG9Ld7Q7tERFPOMWrYmI Aug 09 18:53:06.989770 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Id: None Aug 09 18:53:06.989770 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Name: None Aug 09 18:53:06.989770 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Identity-Status: Confirmed Aug 09 18:53:06.989770 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Is-Admin-Project: True Aug 09 18:53:06.989770 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Id: default Aug 09 18:53:06.989770 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Name: Default Aug 09 18:53:06.989770 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Id: 4a745db383cb452187f7c82b9977c09b Aug 09 18:53:06.989770 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Name: tempest-AttachVolumeNegativeTest-1856281892 Aug 09 18:53:06.989770 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Role: reader,member Aug 09 18:53:06.989770 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Roles: reader,member Aug 09 18:53:06.991392 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4a745db383cb452187f7c82b9977c09b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a745db383cb452187f7c82b9977c09b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4a745db383cb452187f7c82b9977c09b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a745db383cb452187f7c82b9977c09b"}]}] Aug 09 18:53:06.991392 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant: tempest-AttachVolumeNegativeTest-1856281892 Aug 09 18:53:06.991392 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Id: 4a745db383cb452187f7c82b9977c09b Aug 09 18:53:06.991392 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1856281892 Aug 09 18:53:06.991392 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User: tempest-AttachVolumeNegativeTest-1856281892-project Aug 09 18:53:06.991392 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Id: default Aug 09 18:53:06.991392 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Name: Default Aug 09 18:53:06.991392 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Id: 00491255f4b44125b6dc9f816c9bbb58 Aug 09 18:53:06.991392 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Name: tempest-AttachVolumeNegativeTest-1856281892-project Aug 09 18:53:06.991392 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Aug 09 18:53:06.991392 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: {"volumeAttachment": {"volumeId": "a2cf52a0-1953-4673-b81d-9aa9a817484e"}} Aug 09 18:53:06.991392 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: method: > Aug 09 18:53:06.992922 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: exception: Invalid volume: volume a2cf52a0-1953-4673-b81d-9aa9a817484e is already attached to instances: 743aafc6-1787-4c6e-be09-3b460a00d5e9 Aug 09 18:53:06.992922 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: action_args: {'server_id': '6ba05bdf-8754-4e31-976a-816a4485a252', 'body': {'volumeAttachment': {'volumeId': 'a2cf52a0-1953-4673-b81d-9aa9a817484e'}}} Aug 09 18:53:06.992922 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:53:06.992922 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:53:06.992922 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 09 18:53:06.992922 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 09 18:53:06.992922 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 18:53:06.992922 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 18:53:06.992922 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 09 18:53:06.992922 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 18:53:06.992922 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 09 18:53:06.992922 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 09 18:53:06.992922 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 09 18:53:06.992922 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 09 18:53:06.992922 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a2cf52a0-1953-4673-b81d-9aa9a817484e is already attached to instances: 743aafc6-1787-4c6e-be09-3b460a00d5e9 Aug 09 18:53:06.992922 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:53:06.992922 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:53:06.992922 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:53:06.992922 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:53:06.994415 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:53:06.994415 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:53:06.994415 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:53:06.994415 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:53:06.994415 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:53:06.994415 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:53:06.994415 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 18:53:06.994415 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 18:53:06.994415 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 18:53:06.994415 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 18:53:06.994415 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 18:53:06.994415 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 18:53:06.994415 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 09 18:53:06.994415 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 09 18:53:06.994415 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a2cf52a0-1953-4673-b81d-9aa9a817484e is already attached to instances: 743aafc6-1787-4c6e-be09-3b460a00d5e9 Aug 09 18:53:06.994415 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:53:06.994415 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:53:06.994415 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:53:06.994415 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:53:06.994415 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:53:06.995859 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:53:06.995859 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:53:06.995859 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:53:06.995859 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a2cf52a0-1953-4673-b81d-9aa9a817484e is already attached to instances: 743aafc6-1787-4c6e-be09-3b460a00d5e9 Aug 09 18:53:06.995859 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:53:06.995859 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-c1c35dcb-4833-49fb-867e-4744894bf1e2 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Returning 400 to user: Invalid volume: volume a2cf52a0-1953-4673-b81d-9aa9a817484e is already attached to instances: 743aafc6-1787-4c6e-be09-3b460a00d5e9 {{(pid=124726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:53:06.995859 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-c1c35dcb-4833-49fb-867e-4744894bf1e2 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "POST /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.116713 Aug 09 18:53:06.995859 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 245/505] 10.222.0.57 () {60 vars in 1323 bytes} [Tue Aug 9 18:53:06 2022] POST /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252/os-volume_attachments => generated 174 bytes in 118 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 18:53:07.000965 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-cbe412c1-5a3d-4268-ae0f-78799e53fa59 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:07.001488 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-cbe412c1-5a3d-4268-ae0f-78799e53fa59 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 6ba05bdf-8754-4e31-976a-816a4485a252] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:07.008875 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cbe412c1-5a3d-4268-ae0f-78799e53fa59 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:07.009354 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cbe412c1-5a3d-4268-ae0f-78799e53fa59 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:07.009818 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cbe412c1-5a3d-4268-ae0f-78799e53fa59 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:07.010602 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cbe412c1-5a3d-4268-ae0f-78799e53fa59 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:07.011011 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cbe412c1-5a3d-4268-ae0f-78799e53fa59 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:07.011439 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cbe412c1-5a3d-4268-ae0f-78799e53fa59 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:07.037351 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-cbe412c1-5a3d-4268-ae0f-78799e53fa59 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 6ba05bdf-8754-4e31-976a-816a4485a252] Going to try to terminate instance {{(pid=124725) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:53:07.344776 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-cbe412c1-5a3d-4268-ae0f-78799e53fa59 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "DELETE /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252" status: 204 len: 0 microversion: 2.1 time: 0.346974 Aug 09 18:53:07.349256 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 261/506] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 9 18:53:06 2022] DELETE /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:53:07.355392 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-2edb00d4-aa1e-4e96-9f02-556e3104b926 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:07.356334 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-2edb00d4-aa1e-4e96-9f02-556e3104b926 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 6ba05bdf-8754-4e31-976a-816a4485a252] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:07.362612 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2edb00d4-aa1e-4e96-9f02-556e3104b926 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:07.363492 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2edb00d4-aa1e-4e96-9f02-556e3104b926 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:07.363796 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2edb00d4-aa1e-4e96-9f02-556e3104b926 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:07.364695 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2edb00d4-aa1e-4e96-9f02-556e3104b926 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:07.365336 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2edb00d4-aa1e-4e96-9f02-556e3104b926 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:07.365835 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2edb00d4-aa1e-4e96-9f02-556e3104b926 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:07.502930 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-2edb00d4-aa1e-4e96-9f02-556e3104b926 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:07.510598 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-2edb00d4-aa1e-4e96-9f02-556e3104b926 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252" status: 200 len: 1681 microversion: 2.1 time: 0.159945 Aug 09 18:53:07.514690 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 246/507] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:07 2022] GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:07.642237 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f73cca66-2de9-4ed4-9d2c-ab2439aa02f9 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:07.643055 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-f73cca66-2de9-4ed4-9d2c-ab2439aa02f9 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:07.650064 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f73cca66-2de9-4ed4-9d2c-ab2439aa02f9 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:07.650717 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f73cca66-2de9-4ed4-9d2c-ab2439aa02f9 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:07.651158 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f73cca66-2de9-4ed4-9d2c-ab2439aa02f9 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:07.651854 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f73cca66-2de9-4ed4-9d2c-ab2439aa02f9 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:07.652303 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f73cca66-2de9-4ed4-9d2c-ab2439aa02f9 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:07.652726 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f73cca66-2de9-4ed4-9d2c-ab2439aa02f9 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:07.786450 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f73cca66-2de9-4ed4-9d2c-ab2439aa02f9 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:07.796121 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f73cca66-2de9-4ed4-9d2c-ab2439aa02f9 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2" status: 200 len: 1716 microversion: 2.1 time: 0.158233 Aug 09 18:53:07.796846 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 262/508] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:07 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2 => generated 1716 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:07.860188 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-bdd2fb71-0cda-415d-87df-eb3927590730 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:07.860884 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-bdd2fb71-0cda-415d-87df-eb3927590730 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:07.868435 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-bdd2fb71-0cda-415d-87df-eb3927590730 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:07.869007 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-bdd2fb71-0cda-415d-87df-eb3927590730 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:07.869439 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-bdd2fb71-0cda-415d-87df-eb3927590730 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:07.870163 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-bdd2fb71-0cda-415d-87df-eb3927590730 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:07.870608 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-bdd2fb71-0cda-415d-87df-eb3927590730 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:07.871025 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-bdd2fb71-0cda-415d-87df-eb3927590730 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:07.922919 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-4883910f-e056-4fb0-81e5-3a9b73af0008 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:07.923401 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-4883910f-e056-4fb0-81e5-3a9b73af0008 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:07.929951 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4883910f-e056-4fb0-81e5-3a9b73af0008 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:07.930929 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4883910f-e056-4fb0-81e5-3a9b73af0008 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:07.931354 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4883910f-e056-4fb0-81e5-3a9b73af0008 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:07.933828 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4883910f-e056-4fb0-81e5-3a9b73af0008 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:07.934299 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4883910f-e056-4fb0-81e5-3a9b73af0008 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:07.935045 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4883910f-e056-4fb0-81e5-3a9b73af0008 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:07.935163 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-bdd2fb71-0cda-415d-87df-eb3927590730 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:07.942875 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-bdd2fb71-0cda-415d-87df-eb3927590730 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:07.944348 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-bdd2fb71-0cda-415d-87df-eb3927590730 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:07.945495 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-bdd2fb71-0cda-415d-87df-eb3927590730 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1351 microversion: 2.20 time: 0.089129 Aug 09 18:53:07.946063 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 247/509] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:53:07 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1351 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:53:08.057248 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-4883910f-e056-4fb0-81e5-3a9b73af0008 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] HTTP exception thrown: Cannot 'detach_volume' instance e15bc2b4-4702-4ee5-9483-87db30954da2 while it is in vm_state rescued Aug 09 18:53:08.058922 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-4883910f-e056-4fb0-81e5-3a9b73af0008 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Request method failure captured: Aug 09 18:53:08.058922 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: request: DELETE /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2/os-volume_attachments/33655ffe-0c8d-447b-bf46-cc9509cd41ba HTTP/1.1 Aug 09 18:53:08.058922 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept: application/json Aug 09 18:53:08.058922 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Aug 09 18:53:08.058922 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Connection: close Aug 09 18:53:08.058922 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Length: 0 Aug 09 18:53:08.058922 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Type: application/json Aug 09 18:53:08.058922 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Host: 10.222.0.57 Aug 09 18:53:08.058922 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Aug 09 18:53:08.058922 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.11 Aug 09 18:53:08.058922 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABi8qwcYn_PR1bY-m21eiDaM-K65e27GCgB1hyw1OuGXRk37b51HFhla9CV-9Ypj2nAUtt--h-xdiAP9q3XcmfWWUfjCi-I0NaYuSy2aQQRGG3_zykXOBy5GJW4FO-NWWjB3ENfbKd8Tz-WldjUgCB_nawpLyJ7FUR9ShKkFO_khGgJwfI Aug 09 18:53:08.058922 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Aug 09 18:53:08.058922 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Aug 09 18:53:08.058922 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Aug 09 18:53:08.058922 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Aug 09 18:53:08.058922 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Aug 09 18:53:08.058922 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Aug 09 18:53:08.058922 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Id: d3c7915d78334e95a41a32f0f3b5b084 Aug 09 18:53:08.058922 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-687112300 Aug 09 18:53:08.058922 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Role: reader,member Aug 09 18:53:08.058922 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Roles: reader,member Aug 09 18:53:08.060450 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d3c7915d78334e95a41a32f0f3b5b084", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d3c7915d78334e95a41a32f0f3b5b084"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d3c7915d78334e95a41a32f0f3b5b084"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d3c7915d78334e95a41a32f0f3b5b084"}]}] Aug 09 18:53:08.060450 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-ServerRescueNegativeTestJSON-687112300 Aug 09 18:53:08.060450 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Id: d3c7915d78334e95a41a32f0f3b5b084 Aug 09 18:53:08.060450 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-687112300 Aug 09 18:53:08.060450 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User: tempest-ServerRescueNegativeTestJSON-687112300-project Aug 09 18:53:08.060450 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Aug 09 18:53:08.060450 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Aug 09 18:53:08.060450 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Id: 04da0f4276d6457c889ecb3006842e9c Aug 09 18:53:08.060450 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-ServerRescueNegativeTestJSON-687112300-project Aug 09 18:53:08.060450 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: method: > Aug 09 18:53:08.060450 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: exception: Cannot 'detach_volume' instance e15bc2b4-4702-4ee5-9483-87db30954da2 while it is in vm_state rescued Aug 09 18:53:08.061265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: action_args: {'server_id': 'e15bc2b4-4702-4ee5-9483-87db30954da2', 'id': '33655ffe-0c8d-447b-bf46-cc9509cd41ba'} Aug 09 18:53:08.061265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:53:08.061265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:53:08.061265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 09 18:53:08.061265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 09 18:53:08.061265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 18:53:08.061265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 18:53:08.061265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 18:53:08.061265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 18:53:08.061265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e15bc2b4-4702-4ee5-9483-87db30954da2 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 09 18:53:08.061265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:53:08.061265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:53:08.061265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:53:08.061265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:53:08.061265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:53:08.061265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:53:08.061265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:53:08.061265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:53:08.061265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:53:08.061265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:53:08.062709 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 09 18:53:08.062709 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 18:53:08.062709 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 18:53:08.062709 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 18:53:08.062709 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance e15bc2b4-4702-4ee5-9483-87db30954da2 while it is in vm_state rescued Aug 09 18:53:08.062709 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:53:08.062709 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:53:08.062709 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:53:08.062709 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:53:08.062709 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:53:08.062709 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:53:08.062709 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:53:08.062709 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:53:08.062709 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance e15bc2b4-4702-4ee5-9483-87db30954da2 while it is in vm_state rescued Aug 09 18:53:08.062709 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:53:08.062709 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-4883910f-e056-4fb0-81e5-3a9b73af0008 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Returning 409 to user: Cannot 'detach_volume' instance e15bc2b4-4702-4ee5-9483-87db30954da2 while it is in vm_state rescued {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:53:08.063682 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-4883910f-e056-4fb0-81e5-3a9b73af0008 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "DELETE /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2/os-volume_attachments/33655ffe-0c8d-447b-bf46-cc9509cd41ba" status: 409 len: 152 microversion: 2.1 time: 0.141331 Aug 09 18:53:08.063682 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 263/510] 10.222.0.57 () {58 vars in 1416 bytes} [Tue Aug 9 18:53:07 2022] DELETE /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2/os-volume_attachments/33655ffe-0c8d-447b-bf46-cc9509cd41ba => generated 152 bytes in 142 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 09 18:53:08.069281 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-906a8307-e449-43ab-8032-48d70fbdca32 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:53:08.069859 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-906a8307-e449-43ab-8032-48d70fbdca32 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:08.076111 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-906a8307-e449-43ab-8032-48d70fbdca32 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:08.076590 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-906a8307-e449-43ab-8032-48d70fbdca32 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:08.077021 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-906a8307-e449-43ab-8032-48d70fbdca32 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:08.077788 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-906a8307-e449-43ab-8032-48d70fbdca32 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:08.078240 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-906a8307-e449-43ab-8032-48d70fbdca32 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:08.078674 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-906a8307-e449-43ab-8032-48d70fbdca32 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:08.248645 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-906a8307-e449-43ab-8032-48d70fbdca32 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "POST /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2/action" status: 202 len: 0 microversion: 2.1 time: 0.182903 Aug 09 18:53:08.249215 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 248/511] 10.222.0.57 () {60 vars in 1278 bytes} [Tue Aug 9 18:53:08 2022] POST /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:53:08.260447 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-9b86f009-57e5-461d-a543-383646321d27 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:08.261477 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-9b86f009-57e5-461d-a543-383646321d27 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:08.268220 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9b86f009-57e5-461d-a543-383646321d27 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:08.268766 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9b86f009-57e5-461d-a543-383646321d27 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:08.269241 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9b86f009-57e5-461d-a543-383646321d27 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:08.270041 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9b86f009-57e5-461d-a543-383646321d27 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:08.270537 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9b86f009-57e5-461d-a543-383646321d27 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:08.270964 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9b86f009-57e5-461d-a543-383646321d27 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:08.410194 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-9b86f009-57e5-461d-a543-383646321d27 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:08.418695 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-9b86f009-57e5-461d-a543-383646321d27 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2" status: 200 len: 1724 microversion: 2.1 time: 0.165082 Aug 09 18:53:08.419265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 264/512] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:08 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:08.533225 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-1d451e7d-753f-42bf-be77-02eccc94f5d5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:08.534234 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-1d451e7d-753f-42bf-be77-02eccc94f5d5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 6ba05bdf-8754-4e31-976a-816a4485a252] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:08.540687 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1d451e7d-753f-42bf-be77-02eccc94f5d5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:08.541246 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1d451e7d-753f-42bf-be77-02eccc94f5d5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:08.541791 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1d451e7d-753f-42bf-be77-02eccc94f5d5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:08.542559 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1d451e7d-753f-42bf-be77-02eccc94f5d5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:08.543098 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1d451e7d-753f-42bf-be77-02eccc94f5d5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:08.543616 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1d451e7d-753f-42bf-be77-02eccc94f5d5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:08.747746 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-1d451e7d-753f-42bf-be77-02eccc94f5d5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:08.756493 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-1d451e7d-753f-42bf-be77-02eccc94f5d5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252" status: 200 len: 1681 microversion: 2.1 time: 0.227744 Aug 09 18:53:08.757549 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 249/513] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:08 2022] GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252 => generated 1681 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:08.969246 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-fad1ef04-0348-4edc-82d7-189fc671c842 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:08.970613 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-fad1ef04-0348-4edc-82d7-189fc671c842 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:08.977959 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fad1ef04-0348-4edc-82d7-189fc671c842 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:08.978640 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fad1ef04-0348-4edc-82d7-189fc671c842 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:08.979086 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fad1ef04-0348-4edc-82d7-189fc671c842 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:08.979805 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fad1ef04-0348-4edc-82d7-189fc671c842 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:08.980319 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fad1ef04-0348-4edc-82d7-189fc671c842 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:08.980910 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fad1ef04-0348-4edc-82d7-189fc671c842 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:09.073457 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-fad1ef04-0348-4edc-82d7-189fc671c842 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:09.082542 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-fad1ef04-0348-4edc-82d7-189fc671c842 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:09.084046 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-fad1ef04-0348-4edc-82d7-189fc671c842 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:09.085476 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-fad1ef04-0348-4edc-82d7-189fc671c842 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1339 microversion: 2.20 time: 0.120436 Aug 09 18:53:09.089605 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 265/514] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:53:08 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1339 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:53:09.440387 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-9198f339-78b0-43e1-a677-c5d4badb990e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:09.441651 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-9198f339-78b0-43e1-a677-c5d4badb990e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:09.448248 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9198f339-78b0-43e1-a677-c5d4badb990e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:09.448726 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9198f339-78b0-43e1-a677-c5d4badb990e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:09.449152 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9198f339-78b0-43e1-a677-c5d4badb990e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:09.449874 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9198f339-78b0-43e1-a677-c5d4badb990e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:09.450320 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9198f339-78b0-43e1-a677-c5d4badb990e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:09.450739 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9198f339-78b0-43e1-a677-c5d4badb990e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:09.660837 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-9198f339-78b0-43e1-a677-c5d4badb990e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:09.669891 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-9198f339-78b0-43e1-a677-c5d4badb990e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2" status: 200 len: 1724 microversion: 2.1 time: 0.233308 Aug 09 18:53:09.670473 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 250/515] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:09 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2 => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:53:09.781631 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d903675a-86a1-4db7-be7e-0ffb9df7338d tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:09.782653 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-d903675a-86a1-4db7-be7e-0ffb9df7338d tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 6ba05bdf-8754-4e31-976a-816a4485a252] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:09.790936 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d903675a-86a1-4db7-be7e-0ffb9df7338d tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:09.791428 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d903675a-86a1-4db7-be7e-0ffb9df7338d tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:09.791863 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d903675a-86a1-4db7-be7e-0ffb9df7338d tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:09.792566 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d903675a-86a1-4db7-be7e-0ffb9df7338d tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:09.793021 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d903675a-86a1-4db7-be7e-0ffb9df7338d tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:09.793443 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d903675a-86a1-4db7-be7e-0ffb9df7338d tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:09.860707 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d903675a-86a1-4db7-be7e-0ffb9df7338d tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:09.868426 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-d903675a-86a1-4db7-be7e-0ffb9df7338d tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252" status: 200 len: 1614 microversion: 2.1 time: 0.092416 Aug 09 18:53:09.869044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 266/516] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:09 2022] GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252 => generated 1614 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:53:10.108679 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-706eda79-aac1-44a2-aecc-32e5dc8ce2b7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:10.109244 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-706eda79-aac1-44a2-aecc-32e5dc8ce2b7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:10.115947 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-706eda79-aac1-44a2-aecc-32e5dc8ce2b7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:10.116488 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-706eda79-aac1-44a2-aecc-32e5dc8ce2b7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:10.116924 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-706eda79-aac1-44a2-aecc-32e5dc8ce2b7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:10.117956 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-706eda79-aac1-44a2-aecc-32e5dc8ce2b7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:10.118468 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-706eda79-aac1-44a2-aecc-32e5dc8ce2b7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:10.118898 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-706eda79-aac1-44a2-aecc-32e5dc8ce2b7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:10.161002 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-d666193f-20ac-44a6-84c4-2759f94fa633 req-dc3a201a-c73c-453c-baf8-344d038a08c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ba05bdf-8754-4e31-976a-816a4485a252", "name": "network-vif-deleted", "tag": "43d43174-05ce-4aa4-847d-a37146ed16a3"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:53:10.172007 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-d666193f-20ac-44a6-84c4-2759f94fa633 req-dc3a201a-c73c-453c-baf8-344d038a08c6 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:10.173378 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-d666193f-20ac-44a6-84c4-2759f94fa633 req-dc3a201a-c73c-453c-baf8-344d038a08c6 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:10.173925 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-d666193f-20ac-44a6-84c4-2759f94fa633 req-dc3a201a-c73c-453c-baf8-344d038a08c6 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:10.186692 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-d666193f-20ac-44a6-84c4-2759f94fa633 req-dc3a201a-c73c-453c-baf8-344d038a08c6 service nova] Creating event network-vif-deleted:43d43174-05ce-4aa4-847d-a37146ed16a3 for instance 6ba05bdf-8754-4e31-976a-816a4485a252 on hv-cinder-82660 Aug 09 18:53:10.192684 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-d666193f-20ac-44a6-84c4-2759f94fa633 req-dc3a201a-c73c-453c-baf8-344d038a08c6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035685 Aug 09 18:53:10.194072 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 267/517] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:53:10.290142 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-706eda79-aac1-44a2-aecc-32e5dc8ce2b7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:10.298977 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-706eda79-aac1-44a2-aecc-32e5dc8ce2b7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:10.300771 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-706eda79-aac1-44a2-aecc-32e5dc8ce2b7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:10.301982 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-706eda79-aac1-44a2-aecc-32e5dc8ce2b7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1407 microversion: 2.20 time: 0.197533 Aug 09 18:53:10.302565 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 251/518] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:53:10 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:53:10.694018 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f57daf82-db78-47ca-9b1f-6b9d5c047f40 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:10.694759 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-f57daf82-db78-47ca-9b1f-6b9d5c047f40 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:10.703376 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f57daf82-db78-47ca-9b1f-6b9d5c047f40 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:10.704277 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f57daf82-db78-47ca-9b1f-6b9d5c047f40 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:10.704921 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f57daf82-db78-47ca-9b1f-6b9d5c047f40 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:10.705921 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f57daf82-db78-47ca-9b1f-6b9d5c047f40 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:10.706538 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f57daf82-db78-47ca-9b1f-6b9d5c047f40 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:10.707127 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f57daf82-db78-47ca-9b1f-6b9d5c047f40 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:10.857055 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f57daf82-db78-47ca-9b1f-6b9d5c047f40 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:10.868753 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f57daf82-db78-47ca-9b1f-6b9d5c047f40 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2" status: 200 len: 1724 microversion: 2.1 time: 0.177632 Aug 09 18:53:10.872185 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 268/519] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:10 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:10.891771 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-368fb24a-9d12-4059-8d13-35a02ce1a132 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:10.892758 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-368fb24a-9d12-4059-8d13-35a02ce1a132 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 6ba05bdf-8754-4e31-976a-816a4485a252] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:10.900479 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-368fb24a-9d12-4059-8d13-35a02ce1a132 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:10.907610 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-368fb24a-9d12-4059-8d13-35a02ce1a132 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:10.907610 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-368fb24a-9d12-4059-8d13-35a02ce1a132 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:10.907610 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-368fb24a-9d12-4059-8d13-35a02ce1a132 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:10.907610 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-368fb24a-9d12-4059-8d13-35a02ce1a132 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:10.908025 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-368fb24a-9d12-4059-8d13-35a02ce1a132 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:10.937352 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-368fb24a-9d12-4059-8d13-35a02ce1a132 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:10.937871 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-368fb24a-9d12-4059-8d13-35a02ce1a132 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:10.938298 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-368fb24a-9d12-4059-8d13-35a02ce1a132 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:10.938751 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.objects.instance [None req-368fb24a-9d12-4059-8d13-35a02ce1a132 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lazy-loading 'fault' on Instance uuid 6ba05bdf-8754-4e31-976a-816a4485a252 {{(pid=124726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:53:10.998668 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-368fb24a-9d12-4059-8d13-35a02ce1a132 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:11.007085 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-368fb24a-9d12-4059-8d13-35a02ce1a132 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252" status: 200 len: 1330 microversion: 2.1 time: 0.119848 Aug 09 18:53:11.008596 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 252/520] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:10 2022] GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252 => generated 1330 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:11.325733 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-9e3bd325-ed61-494f-be34-c85d5e3d44fe tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:11.327052 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-9e3bd325-ed61-494f-be34-c85d5e3d44fe tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:11.339738 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9e3bd325-ed61-494f-be34-c85d5e3d44fe tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:11.340328 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9e3bd325-ed61-494f-be34-c85d5e3d44fe tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:11.340829 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9e3bd325-ed61-494f-be34-c85d5e3d44fe tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:11.341637 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9e3bd325-ed61-494f-be34-c85d5e3d44fe tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:11.342160 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9e3bd325-ed61-494f-be34-c85d5e3d44fe tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:11.342902 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9e3bd325-ed61-494f-be34-c85d5e3d44fe tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:11.485665 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-9e3bd325-ed61-494f-be34-c85d5e3d44fe tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:11.495345 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-9e3bd325-ed61-494f-be34-c85d5e3d44fe tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:11.496981 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-9e3bd325-ed61-494f-be34-c85d5e3d44fe tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:11.498544 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-9e3bd325-ed61-494f-be34-c85d5e3d44fe tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1407 microversion: 2.20 time: 0.178128 Aug 09 18:53:11.500953 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 269/521] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:53:11 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:53:11.896491 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-3526d71a-3611-4fa7-9233-fbff58326a1e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:11.897254 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-3526d71a-3611-4fa7-9233-fbff58326a1e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:11.904379 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3526d71a-3611-4fa7-9233-fbff58326a1e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:11.904865 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3526d71a-3611-4fa7-9233-fbff58326a1e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:11.905310 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3526d71a-3611-4fa7-9233-fbff58326a1e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:11.906040 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3526d71a-3611-4fa7-9233-fbff58326a1e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:11.906491 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3526d71a-3611-4fa7-9233-fbff58326a1e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:11.906912 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3526d71a-3611-4fa7-9233-fbff58326a1e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:12.029317 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-32b92709-da4a-4839-9c87-a617ee84d4a0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:12.030047 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-32b92709-da4a-4839-9c87-a617ee84d4a0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 6ba05bdf-8754-4e31-976a-816a4485a252] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:12.036760 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-32b92709-da4a-4839-9c87-a617ee84d4a0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:12.037352 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-32b92709-da4a-4839-9c87-a617ee84d4a0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:12.037867 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-32b92709-da4a-4839-9c87-a617ee84d4a0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:12.038643 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-32b92709-da4a-4839-9c87-a617ee84d4a0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:12.039189 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-32b92709-da4a-4839-9c87-a617ee84d4a0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:12.040273 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-32b92709-da4a-4839-9c87-a617ee84d4a0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:12.075664 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-32b92709-da4a-4839-9c87-a617ee84d4a0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:12.076072 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-32b92709-da4a-4839-9c87-a617ee84d4a0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:12.076501 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-32b92709-da4a-4839-9c87-a617ee84d4a0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:12.076957 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.objects.instance [None req-32b92709-da4a-4839-9c87-a617ee84d4a0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lazy-loading 'fault' on Instance uuid 6ba05bdf-8754-4e31-976a-816a4485a252 {{(pid=124725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:53:12.121970 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-32b92709-da4a-4839-9c87-a617ee84d4a0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:12.129863 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-32b92709-da4a-4839-9c87-a617ee84d4a0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252" status: 200 len: 1330 microversion: 2.1 time: 0.104637 Aug 09 18:53:12.140134 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 270/522] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:12 2022] GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252 => generated 1330 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:12.255086 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-7ebb9719-ddb8-48e8-ad92-2f02fd52cc6c req-e9285986-237f-4197-a286-0aed0f74b455 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f84c5e3-7213-4bd2-ad7c-4794aab9d631", "tag": "d2e3768b-d787-45b4-941d-9253bd20d687"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:53:12.266191 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-7ebb9719-ddb8-48e8-ad92-2f02fd52cc6c req-e9285986-237f-4197-a286-0aed0f74b455 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:12.266680 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-7ebb9719-ddb8-48e8-ad92-2f02fd52cc6c req-e9285986-237f-4197-a286-0aed0f74b455 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:12.267108 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-7ebb9719-ddb8-48e8-ad92-2f02fd52cc6c req-e9285986-237f-4197-a286-0aed0f74b455 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:12.281696 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-7ebb9719-ddb8-48e8-ad92-2f02fd52cc6c req-e9285986-237f-4197-a286-0aed0f74b455 service nova] Creating event network-changed:d2e3768b-d787-45b4-941d-9253bd20d687 for instance 8f84c5e3-7213-4bd2-ad7c-4794aab9d631 on hv-cinder-82660 Aug 09 18:53:12.287471 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-7ebb9719-ddb8-48e8-ad92-2f02fd52cc6c req-e9285986-237f-4197-a286-0aed0f74b455 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035794 Aug 09 18:53:12.288299 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 271/523] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:53:12.392671 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-3526d71a-3611-4fa7-9233-fbff58326a1e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:12.401757 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-3526d71a-3611-4fa7-9233-fbff58326a1e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2" status: 200 len: 1730 microversion: 2.1 time: 0.509205 Aug 09 18:53:12.402656 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 253/524] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:11 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2 => generated 1730 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:12.422936 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-1c70c6a6-0aa7-481d-bf60-e9a162086528 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:12.423508 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-1c70c6a6-0aa7-481d-bf60-e9a162086528 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:12.431001 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1c70c6a6-0aa7-481d-bf60-e9a162086528 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:12.431497 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1c70c6a6-0aa7-481d-bf60-e9a162086528 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:12.431972 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1c70c6a6-0aa7-481d-bf60-e9a162086528 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:12.432686 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1c70c6a6-0aa7-481d-bf60-e9a162086528 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:12.433140 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1c70c6a6-0aa7-481d-bf60-e9a162086528 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:12.433603 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1c70c6a6-0aa7-481d-bf60-e9a162086528 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:12.517992 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-1c70c6a6-0aa7-481d-bf60-e9a162086528 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099266 Aug 09 18:53:12.518587 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 272/525] 10.222.0.57 () {58 vars in 1275 bytes} [Tue Aug 9 18:53:12 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:53:12.522006 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-7ec581f6-5ee0-48ce-b0cb-7d6c41b76e32 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:12.522622 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-7ec581f6-5ee0-48ce-b0cb-7d6c41b76e32 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:12.529459 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7ec581f6-5ee0-48ce-b0cb-7d6c41b76e32 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:12.529974 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7ec581f6-5ee0-48ce-b0cb-7d6c41b76e32 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:12.530411 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7ec581f6-5ee0-48ce-b0cb-7d6c41b76e32 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:12.531221 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7ec581f6-5ee0-48ce-b0cb-7d6c41b76e32 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:12.531563 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7ec581f6-5ee0-48ce-b0cb-7d6c41b76e32 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:12.531988 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7ec581f6-5ee0-48ce-b0cb-7d6c41b76e32 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:12.772235 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-7ec581f6-5ee0-48ce-b0cb-7d6c41b76e32 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:12.791720 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-7ec581f6-5ee0-48ce-b0cb-7d6c41b76e32 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:12.793503 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-7ec581f6-5ee0-48ce-b0cb-7d6c41b76e32 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:12.794665 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-7ec581f6-5ee0-48ce-b0cb-7d6c41b76e32 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1407 microversion: 2.20 time: 0.276656 Aug 09 18:53:12.795244 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 254/526] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:53:12 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1407 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:53:13.151507 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f7aabc22-dc90-4011-838a-3aa360764039 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:13.152190 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-f7aabc22-dc90-4011-838a-3aa360764039 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 6ba05bdf-8754-4e31-976a-816a4485a252] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:13.158475 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f7aabc22-dc90-4011-838a-3aa360764039 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:13.159272 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f7aabc22-dc90-4011-838a-3aa360764039 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:13.159732 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f7aabc22-dc90-4011-838a-3aa360764039 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:13.160520 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f7aabc22-dc90-4011-838a-3aa360764039 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:13.161023 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f7aabc22-dc90-4011-838a-3aa360764039 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:13.161440 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f7aabc22-dc90-4011-838a-3aa360764039 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:13.176266 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-f7aabc22-dc90-4011-838a-3aa360764039 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] HTTP exception thrown: Instance 6ba05bdf-8754-4e31-976a-816a4485a252 could not be found. Aug 09 18:53:13.177953 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f7aabc22-dc90-4011-838a-3aa360764039 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Request method failure captured: Aug 09 18:53:13.177953 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: request: GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252 HTTP/1.1 Aug 09 18:53:13.177953 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept: application/json Aug 09 18:53:13.177953 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Aug 09 18:53:13.177953 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Connection: close Aug 09 18:53:13.177953 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Length: 0 Aug 09 18:53:13.177953 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Type: application/json Aug 09 18:53:13.177953 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Host: 10.222.0.57 Aug 09 18:53:13.177953 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Aug 09 18:53:13.177953 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.11 Aug 09 18:53:13.177953 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABi8qxu6GlCXsghs7mXHsJ6lMdriR0lCN6zx0jJtIVa-hoSSpRyn9kABjaS5Ya_Ocw2sU0SEZSB-MC5jyn7nC01Qf-R3Wxc4u_OmCKdxSmXeuRuDoxnEqYVjV6mxSKvywrengnzW8AvtzIMJfiluX7W9B1UousoG9Ld7Q7tERFPOMWrYmI Aug 09 18:53:13.177953 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Aug 09 18:53:13.177953 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Aug 09 18:53:13.177953 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Aug 09 18:53:13.177953 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Aug 09 18:53:13.177953 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Aug 09 18:53:13.177953 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Aug 09 18:53:13.177953 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Id: 4a745db383cb452187f7c82b9977c09b Aug 09 18:53:13.177953 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-AttachVolumeNegativeTest-1856281892 Aug 09 18:53:13.177953 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Role: reader,member Aug 09 18:53:13.177953 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Roles: reader,member Aug 09 18:53:13.179729 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4a745db383cb452187f7c82b9977c09b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a745db383cb452187f7c82b9977c09b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4a745db383cb452187f7c82b9977c09b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a745db383cb452187f7c82b9977c09b"}]}] Aug 09 18:53:13.179729 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-AttachVolumeNegativeTest-1856281892 Aug 09 18:53:13.179729 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 4a745db383cb452187f7c82b9977c09b Aug 09 18:53:13.179729 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1856281892 Aug 09 18:53:13.179729 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User: tempest-AttachVolumeNegativeTest-1856281892-project Aug 09 18:53:13.179729 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Aug 09 18:53:13.179729 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Aug 09 18:53:13.179729 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Id: 00491255f4b44125b6dc9f816c9bbb58 Aug 09 18:53:13.179729 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-AttachVolumeNegativeTest-1856281892-project Aug 09 18:53:13.179729 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: method: > Aug 09 18:53:13.179729 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: exception: Instance 6ba05bdf-8754-4e31-976a-816a4485a252 could not be found. Aug 09 18:53:13.179729 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: action_args: {'id': '6ba05bdf-8754-4e31-976a-816a4485a252'} Aug 09 18:53:13.181181 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:53:13.181181 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:53:13.181181 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:53:13.181181 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:53:13.181181 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:53:13.181181 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:53:13.181181 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:53:13.181181 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:53:13.181181 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:53:13.181181 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:53:13.181181 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ba05bdf-8754-4e31-976a-816a4485a252 could not be found. Aug 09 18:53:13.181181 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:53:13.181181 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:53:13.181181 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:53:13.181181 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:53:13.181181 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:53:13.181181 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:53:13.181181 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:53:13.181181 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:53:13.181181 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:53:13.182794 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:53:13.182794 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:53:13.182794 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:53:13.182794 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:53:13.182794 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:53:13.182794 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:53:13.182794 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:53:13.182794 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ba05bdf-8754-4e31-976a-816a4485a252 could not be found. Aug 09 18:53:13.182794 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:53:13.182794 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:53:13.182794 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:53:13.182794 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:53:13.182794 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:53:13.182794 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:53:13.182794 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:53:13.182794 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:53:13.182794 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ba05bdf-8754-4e31-976a-816a4485a252 could not be found. Aug 09 18:53:13.182794 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:53:13.184187 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f7aabc22-dc90-4011-838a-3aa360764039 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Returning 404 to user: Instance 6ba05bdf-8754-4e31-976a-816a4485a252 could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:53:13.184187 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f7aabc22-dc90-4011-838a-3aa360764039 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252" status: 404 len: 111 microversion: 2.1 time: 0.032886 Aug 09 18:53:13.184527 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 273/527] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:13 2022] GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:53:13.189386 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-56d96615-0730-4fac-8809-8ec3d2802000 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '.version_select at 0x7f8d69ca5b80>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:13.260559 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-56d96615-0730-4fac-8809-8ec3d2802000 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-205942855" status: 202 len: 0 microversion: 2.1 time: 0.074977 Aug 09 18:53:13.261497 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 255/528] 10.222.0.57 () {58 vars in 1218 bytes} [Tue Aug 9 18:53:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-205942855 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:53:13.816411 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=2 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:53:13.817711 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=6 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:53:13.827044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-1c03c405-11ed-4e10-a0f6-f4c72dcbb4d5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:13.828673 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-1c03c405-11ed-4e10-a0f6-f4c72dcbb4d5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:13.841563 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1c03c405-11ed-4e10-a0f6-f4c72dcbb4d5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:13.843459 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1c03c405-11ed-4e10-a0f6-f4c72dcbb4d5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:13.844698 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1c03c405-11ed-4e10-a0f6-f4c72dcbb4d5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:13.846089 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1c03c405-11ed-4e10-a0f6-f4c72dcbb4d5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:13.847052 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1c03c405-11ed-4e10-a0f6-f4c72dcbb4d5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:13.848018 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1c03c405-11ed-4e10-a0f6-f4c72dcbb4d5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:14.077221 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1c03c405-11ed-4e10-a0f6-f4c72dcbb4d5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:14.089114 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1c03c405-11ed-4e10-a0f6-f4c72dcbb4d5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:14.091067 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1c03c405-11ed-4e10-a0f6-f4c72dcbb4d5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:14.092686 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-1c03c405-11ed-4e10-a0f6-f4c72dcbb4d5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1407 microversion: 2.20 time: 0.277667 Aug 09 18:53:14.106291 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 274/529] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:53:13 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1407 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:53:14.302041 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell0:SELECT=6 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:53:14.307602 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-e673a538-8964-4b23-86d7-17e1dc38fcb9 req-810ef686-22ef-46ed-a863-00506c3902f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e15bc2b4-4702-4ee5-9483-87db30954da2", "tag": "6d0d654f-2f8f-4f17-bf93-aa249db5c6d8"}, {"name": "network-changed", "server_uuid": "e15bc2b4-4702-4ee5-9483-87db30954da2", "tag": "6d0d654f-2f8f-4f17-bf93-aa249db5c6d8"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:53:14.318116 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-e673a538-8964-4b23-86d7-17e1dc38fcb9 req-810ef686-22ef-46ed-a863-00506c3902f7 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:14.318697 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-e673a538-8964-4b23-86d7-17e1dc38fcb9 req-810ef686-22ef-46ed-a863-00506c3902f7 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:14.319195 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-e673a538-8964-4b23-86d7-17e1dc38fcb9 req-810ef686-22ef-46ed-a863-00506c3902f7 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:14.331154 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-e673a538-8964-4b23-86d7-17e1dc38fcb9 req-810ef686-22ef-46ed-a863-00506c3902f7 service nova] Creating event network-changed:6d0d654f-2f8f-4f17-bf93-aa249db5c6d8 for instance e15bc2b4-4702-4ee5-9483-87db30954da2 on hv-cinder-82660 Aug 09 18:53:14.331775 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-e673a538-8964-4b23-86d7-17e1dc38fcb9 req-810ef686-22ef-46ed-a863-00506c3902f7 service nova] Creating event network-changed:6d0d654f-2f8f-4f17-bf93-aa249db5c6d8 for instance e15bc2b4-4702-4ee5-9483-87db30954da2 on hv-cinder-82660 Aug 09 18:53:14.337386 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-e673a538-8964-4b23-86d7-17e1dc38fcb9 req-810ef686-22ef-46ed-a863-00506c3902f7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.036002 Aug 09 18:53:14.338460 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 256/530] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:53:14.497206 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-672f8e16-bed5-493b-b775-3ce3daed0072 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:14.497738 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-672f8e16-bed5-493b-b775-3ce3daed0072 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:14.504767 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-672f8e16-bed5-493b-b775-3ce3daed0072 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:14.507650 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-672f8e16-bed5-493b-b775-3ce3daed0072 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:14.507650 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-672f8e16-bed5-493b-b775-3ce3daed0072 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:14.507650 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-672f8e16-bed5-493b-b775-3ce3daed0072 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:14.507650 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-672f8e16-bed5-493b-b775-3ce3daed0072 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:14.508050 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-672f8e16-bed5-493b-b775-3ce3daed0072 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:14.598995 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.objects.instance [None req-672f8e16-bed5-493b-b775-3ce3daed0072 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lazy-loading 'services' on Instance uuid 743aafc6-1787-4c6e-be09-3b460a00d5e9 {{(pid=124725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:53:14.905199 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-672f8e16-bed5-493b-b775-3ce3daed0072 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "DELETE /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9/os-volume_attachments/a2cf52a0-1953-4673-b81d-9aa9a817484e" status: 202 len: 0 microversion: 2.1 time: 0.409127 Aug 09 18:53:14.909779 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 275/531] 10.222.0.57 () {58 vars in 1416 bytes} [Tue Aug 9 18:53:14 2022] DELETE /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9/os-volume_attachments/a2cf52a0-1953-4673-b81d-9aa9a817484e => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:53:14.919552 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-525accc3-c584-4b86-97bb-ee0a19289eb3 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:14.921937 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-525accc3-c584-4b86-97bb-ee0a19289eb3 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:14.923976 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:53:14.929382 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-525accc3-c584-4b86-97bb-ee0a19289eb3 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:14.929932 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-525accc3-c584-4b86-97bb-ee0a19289eb3 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:14.930365 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-525accc3-c584-4b86-97bb-ee0a19289eb3 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:14.931059 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-525accc3-c584-4b86-97bb-ee0a19289eb3 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:14.931507 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-525accc3-c584-4b86-97bb-ee0a19289eb3 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:14.931925 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-525accc3-c584-4b86-97bb-ee0a19289eb3 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:14.962334 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-525accc3-c584-4b86-97bb-ee0a19289eb3 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047952 Aug 09 18:53:14.963024 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 257/532] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 9 18:53:14 2022] GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:53:15.120832 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-21ef4c2a-e758-4fc2-ad3d-6519bf604ed6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:15.121607 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-21ef4c2a-e758-4fc2-ad3d-6519bf604ed6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:15.127963 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-21ef4c2a-e758-4fc2-ad3d-6519bf604ed6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:15.128481 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-21ef4c2a-e758-4fc2-ad3d-6519bf604ed6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:15.128918 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-21ef4c2a-e758-4fc2-ad3d-6519bf604ed6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:15.129653 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-21ef4c2a-e758-4fc2-ad3d-6519bf604ed6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:15.130111 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-21ef4c2a-e758-4fc2-ad3d-6519bf604ed6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:15.130535 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-21ef4c2a-e758-4fc2-ad3d-6519bf604ed6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:15.149427 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:53:15.263833 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-21ef4c2a-e758-4fc2-ad3d-6519bf604ed6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:15.272132 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-21ef4c2a-e758-4fc2-ad3d-6519bf604ed6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:15.274299 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-21ef4c2a-e758-4fc2-ad3d-6519bf604ed6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:15.275403 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-21ef4c2a-e758-4fc2-ad3d-6519bf604ed6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1407 microversion: 2.20 time: 0.158881 Aug 09 18:53:15.275960 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 276/533] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:53:15 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:53:15.510272 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-83749670-9360-451c-86d4-b0fd04bf0933 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:15.512455 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-83749670-9360-451c-86d4-b0fd04bf0933 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:15.519757 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-83749670-9360-451c-86d4-b0fd04bf0933 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:15.519908 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-83749670-9360-451c-86d4-b0fd04bf0933 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:15.520337 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-83749670-9360-451c-86d4-b0fd04bf0933 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:15.521030 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-83749670-9360-451c-86d4-b0fd04bf0933 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:15.521484 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-83749670-9360-451c-86d4-b0fd04bf0933 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:15.521930 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-83749670-9360-451c-86d4-b0fd04bf0933 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:15.552456 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-83749670-9360-451c-86d4-b0fd04bf0933 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046662 Aug 09 18:53:15.553023 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 258/534] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 9 18:53:15 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 18:53:15.618919 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-7b56cd26-b900-4cf2-ae38-809087e25848 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:15.619617 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-7b56cd26-b900-4cf2-ae38-809087e25848 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:15.623086 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:53:15.626697 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7b56cd26-b900-4cf2-ae38-809087e25848 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:15.627181 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7b56cd26-b900-4cf2-ae38-809087e25848 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:15.627619 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7b56cd26-b900-4cf2-ae38-809087e25848 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:15.628406 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7b56cd26-b900-4cf2-ae38-809087e25848 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:15.628944 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7b56cd26-b900-4cf2-ae38-809087e25848 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:15.629373 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7b56cd26-b900-4cf2-ae38-809087e25848 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:15.657737 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-7b56cd26-b900-4cf2-ae38-809087e25848 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Going to try to terminate instance {{(pid=124725) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:53:15.974527 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-3e1cfea6-d317-4a25-8440-856b0b62936a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:15.976532 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-7b56cd26-b900-4cf2-ae38-809087e25848 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 204 len: 0 microversion: 2.1 time: 0.361821 Aug 09 18:53:15.977057 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-3e1cfea6-d317-4a25-8440-856b0b62936a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:15.977912 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 277/535] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 9 18:53:15 2022] DELETE /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:53:15.984181 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3e1cfea6-d317-4a25-8440-856b0b62936a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:15.984722 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3e1cfea6-d317-4a25-8440-856b0b62936a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:15.985378 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3e1cfea6-d317-4a25-8440-856b0b62936a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:15.986121 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3e1cfea6-d317-4a25-8440-856b0b62936a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:15.986579 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3e1cfea6-d317-4a25-8440-856b0b62936a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:15.987008 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3e1cfea6-d317-4a25-8440-856b0b62936a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:15.988365 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-0bfc350d-e6b8-4957-8341-5490ca15ed35 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:15.989069 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-0bfc350d-e6b8-4957-8341-5490ca15ed35 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:15.994980 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0bfc350d-e6b8-4957-8341-5490ca15ed35 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:15.995468 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0bfc350d-e6b8-4957-8341-5490ca15ed35 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:15.995902 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0bfc350d-e6b8-4957-8341-5490ca15ed35 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:15.996598 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0bfc350d-e6b8-4957-8341-5490ca15ed35 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:15.997053 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0bfc350d-e6b8-4957-8341-5490ca15ed35 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:15.997475 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0bfc350d-e6b8-4957-8341-5490ca15ed35 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:16.017891 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-3e1cfea6-d317-4a25-8440-856b0b62936a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047430 Aug 09 18:53:16.018379 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 259/536] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 9 18:53:15 2022] GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:53:16.135573 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-0bfc350d-e6b8-4957-8341-5490ca15ed35 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:16.143225 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-0bfc350d-e6b8-4957-8341-5490ca15ed35 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1673 microversion: 2.1 time: 0.160214 Aug 09 18:53:16.143802 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 278/537] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:15 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:53:16.298752 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-02e6e04f-1a5c-43c9-843e-371e4b6874bc tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:16.299531 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-02e6e04f-1a5c-43c9-843e-371e4b6874bc tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:16.307703 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-02e6e04f-1a5c-43c9-843e-371e4b6874bc tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:16.310530 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-02e6e04f-1a5c-43c9-843e-371e4b6874bc tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:16.310530 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-02e6e04f-1a5c-43c9-843e-371e4b6874bc tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:16.310530 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-02e6e04f-1a5c-43c9-843e-371e4b6874bc tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:16.310530 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-02e6e04f-1a5c-43c9-843e-371e4b6874bc tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:16.310931 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-02e6e04f-1a5c-43c9-843e-371e4b6874bc tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:16.451067 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-02e6e04f-1a5c-43c9-843e-371e4b6874bc tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:16.460017 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-02e6e04f-1a5c-43c9-843e-371e4b6874bc tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:16.461607 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-02e6e04f-1a5c-43c9-843e-371e4b6874bc tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:16.462717 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-02e6e04f-1a5c-43c9-843e-371e4b6874bc tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1407 microversion: 2.20 time: 0.168305 Aug 09 18:53:16.463347 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 260/538] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:53:16 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:53:17.030466 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-0dcd0109-2c88-4f72-9897-72e7658ca3d2 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:17.032783 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-0dcd0109-2c88-4f72-9897-72e7658ca3d2 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:17.039836 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0dcd0109-2c88-4f72-9897-72e7658ca3d2 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:17.040314 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0dcd0109-2c88-4f72-9897-72e7658ca3d2 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:17.040741 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0dcd0109-2c88-4f72-9897-72e7658ca3d2 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:17.041429 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0dcd0109-2c88-4f72-9897-72e7658ca3d2 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:17.041909 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0dcd0109-2c88-4f72-9897-72e7658ca3d2 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:17.042326 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0dcd0109-2c88-4f72-9897-72e7658ca3d2 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:17.073208 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-0dcd0109-2c88-4f72-9897-72e7658ca3d2 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046720 Aug 09 18:53:17.073805 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 279/539] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 9 18:53:17 2022] GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 18:53:17.140900 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-7dad55cc-8fa5-422e-bc4c-75033c695ce2 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:17.141509 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-7dad55cc-8fa5-422e-bc4c-75033c695ce2 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:17.148230 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7dad55cc-8fa5-422e-bc4c-75033c695ce2 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:17.149238 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7dad55cc-8fa5-422e-bc4c-75033c695ce2 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:17.149686 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7dad55cc-8fa5-422e-bc4c-75033c695ce2 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:17.150375 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7dad55cc-8fa5-422e-bc4c-75033c695ce2 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:17.150814 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7dad55cc-8fa5-422e-bc4c-75033c695ce2 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:17.151227 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7dad55cc-8fa5-422e-bc4c-75033c695ce2 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:17.155220 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:53:17.165358 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e787e783-53fc-4a34-a725-3beabb0a6273 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:17.166038 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e787e783-53fc-4a34-a725-3beabb0a6273 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:17.172297 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e787e783-53fc-4a34-a725-3beabb0a6273 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:17.179769 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e787e783-53fc-4a34-a725-3beabb0a6273 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:17.179769 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e787e783-53fc-4a34-a725-3beabb0a6273 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:17.179769 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e787e783-53fc-4a34-a725-3beabb0a6273 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:17.179769 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e787e783-53fc-4a34-a725-3beabb0a6273 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:17.180120 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e787e783-53fc-4a34-a725-3beabb0a6273 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:17.180218 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-7dad55cc-8fa5-422e-bc4c-75033c695ce2 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Going to try to terminate instance {{(pid=124726) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:53:17.311933 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e787e783-53fc-4a34-a725-3beabb0a6273 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:17.319410 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e787e783-53fc-4a34-a725-3beabb0a6273 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1673 microversion: 2.1 time: 0.158650 Aug 09 18:53:17.319982 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 280/540] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:17 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:53:17.484322 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-ce00a48c-ab4a-42f3-9b9d-54cc6b683caa tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:17.484934 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-ce00a48c-ab4a-42f3-9b9d-54cc6b683caa tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:17.491268 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ce00a48c-ab4a-42f3-9b9d-54cc6b683caa tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:17.491757 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ce00a48c-ab4a-42f3-9b9d-54cc6b683caa tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:17.492198 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ce00a48c-ab4a-42f3-9b9d-54cc6b683caa tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:17.492889 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ce00a48c-ab4a-42f3-9b9d-54cc6b683caa tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:17.493339 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ce00a48c-ab4a-42f3-9b9d-54cc6b683caa tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:17.493793 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ce00a48c-ab4a-42f3-9b9d-54cc6b683caa tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:17.542185 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-7dad55cc-8fa5-422e-bc4c-75033c695ce2 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "DELETE /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9" status: 204 len: 0 microversion: 2.1 time: 0.405521 Aug 09 18:53:17.542684 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 261/541] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 9 18:53:17 2022] DELETE /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:53:17.551524 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-3b3ea70a-2554-4e17-9311-e5b0c3a69304 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:17.553235 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-3b3ea70a-2554-4e17-9311-e5b0c3a69304 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:17.558715 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3b3ea70a-2554-4e17-9311-e5b0c3a69304 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:17.559208 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3b3ea70a-2554-4e17-9311-e5b0c3a69304 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:17.559696 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3b3ea70a-2554-4e17-9311-e5b0c3a69304 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:17.560343 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3b3ea70a-2554-4e17-9311-e5b0c3a69304 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:17.560797 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3b3ea70a-2554-4e17-9311-e5b0c3a69304 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:17.561261 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3b3ea70a-2554-4e17-9311-e5b0c3a69304 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:17.629719 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-ce00a48c-ab4a-42f3-9b9d-54cc6b683caa tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:17.638577 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-ce00a48c-ab4a-42f3-9b9d-54cc6b683caa tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:17.640175 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-ce00a48c-ab4a-42f3-9b9d-54cc6b683caa tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:17.641341 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-ce00a48c-ab4a-42f3-9b9d-54cc6b683caa tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1407 microversion: 2.20 time: 0.161029 Aug 09 18:53:17.641931 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 281/542] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:53:17 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:53:17.697981 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-3b3ea70a-2554-4e17-9311-e5b0c3a69304 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:17.705409 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-3b3ea70a-2554-4e17-9311-e5b0c3a69304 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9" status: 200 len: 1684 microversion: 2.1 time: 0.158194 Aug 09 18:53:17.706024 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 262/543] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:17 2022] GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9 => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:53:18.341151 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-874d1eaf-fcb2-4452-9a1a-8f60d00d9de6 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:18.341847 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-874d1eaf-fcb2-4452-9a1a-8f60d00d9de6 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:18.350520 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-874d1eaf-fcb2-4452-9a1a-8f60d00d9de6 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:18.351012 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-874d1eaf-fcb2-4452-9a1a-8f60d00d9de6 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:18.351451 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-874d1eaf-fcb2-4452-9a1a-8f60d00d9de6 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:18.352161 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-874d1eaf-fcb2-4452-9a1a-8f60d00d9de6 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:18.353895 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-874d1eaf-fcb2-4452-9a1a-8f60d00d9de6 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:18.353895 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-874d1eaf-fcb2-4452-9a1a-8f60d00d9de6 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:18.402547 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-164b3170-8537-48f8-ade6-414f3b8eab50 req-247a7261-889b-4f84-ae77-072a85130f08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f84c5e3-7213-4bd2-ad7c-4794aab9d631", "name": "network-vif-plugged", "status": "completed", "tag": "d2e3768b-d787-45b4-941d-9253bd20d687"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:53:18.414318 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-164b3170-8537-48f8-ade6-414f3b8eab50 req-247a7261-889b-4f84-ae77-072a85130f08 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:18.414905 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-164b3170-8537-48f8-ade6-414f3b8eab50 req-247a7261-889b-4f84-ae77-072a85130f08 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:18.415487 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-164b3170-8537-48f8-ade6-414f3b8eab50 req-247a7261-889b-4f84-ae77-072a85130f08 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:18.427164 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-164b3170-8537-48f8-ade6-414f3b8eab50 req-247a7261-889b-4f84-ae77-072a85130f08 service nova] Creating event network-vif-plugged:d2e3768b-d787-45b4-941d-9253bd20d687 for instance 8f84c5e3-7213-4bd2-ad7c-4794aab9d631 on hv-cinder-82660 Aug 09 18:53:18.432234 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-164b3170-8537-48f8-ade6-414f3b8eab50 req-247a7261-889b-4f84-ae77-072a85130f08 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034253 Aug 09 18:53:18.432831 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 263/544] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:53:18.501962 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-874d1eaf-fcb2-4452-9a1a-8f60d00d9de6 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:18.510855 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-874d1eaf-fcb2-4452-9a1a-8f60d00d9de6 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1673 microversion: 2.1 time: 0.174304 Aug 09 18:53:18.511481 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 282/545] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:18 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1673 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:18.672031 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-d67718c5-6fbe-4ab6-851e-32bb73e34c22 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:18.672731 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-d67718c5-6fbe-4ab6-851e-32bb73e34c22 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:18.679387 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d67718c5-6fbe-4ab6-851e-32bb73e34c22 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:18.679783 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d67718c5-6fbe-4ab6-851e-32bb73e34c22 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:18.680725 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d67718c5-6fbe-4ab6-851e-32bb73e34c22 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:18.681418 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d67718c5-6fbe-4ab6-851e-32bb73e34c22 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:18.681905 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d67718c5-6fbe-4ab6-851e-32bb73e34c22 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:18.682377 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d67718c5-6fbe-4ab6-851e-32bb73e34c22 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:18.728101 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-04471196-97b2-466e-81c7-76f9ce1a3ad0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:18.728740 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-04471196-97b2-466e-81c7-76f9ce1a3ad0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:18.734745 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-04471196-97b2-466e-81c7-76f9ce1a3ad0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:18.735405 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-04471196-97b2-466e-81c7-76f9ce1a3ad0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:18.735834 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-04471196-97b2-466e-81c7-76f9ce1a3ad0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:18.736523 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-04471196-97b2-466e-81c7-76f9ce1a3ad0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:18.736966 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-04471196-97b2-466e-81c7-76f9ce1a3ad0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:18.737379 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-04471196-97b2-466e-81c7-76f9ce1a3ad0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:18.821696 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-d67718c5-6fbe-4ab6-851e-32bb73e34c22 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:18.830561 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-d67718c5-6fbe-4ab6-851e-32bb73e34c22 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:18.832208 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-d67718c5-6fbe-4ab6-851e-32bb73e34c22 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:18.833317 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-d67718c5-6fbe-4ab6-851e-32bb73e34c22 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1407 microversion: 2.20 time: 0.165658 Aug 09 18:53:18.834043 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 264/546] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:53:18 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:53:18.882008 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-04471196-97b2-466e-81c7-76f9ce1a3ad0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:18.890917 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-04471196-97b2-466e-81c7-76f9ce1a3ad0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9" status: 200 len: 1684 microversion: 2.1 time: 0.166844 Aug 09 18:53:18.891497 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 283/547] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:18 2022] GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9 => generated 1684 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:53:19.535869 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-8b6bc9cf-728a-4dc1-a823-a2aae233fd8c tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:19.536909 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-8b6bc9cf-728a-4dc1-a823-a2aae233fd8c tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:19.546575 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-8b6bc9cf-728a-4dc1-a823-a2aae233fd8c tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:19.547068 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-8b6bc9cf-728a-4dc1-a823-a2aae233fd8c tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:19.547505 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-8b6bc9cf-728a-4dc1-a823-a2aae233fd8c tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:19.548216 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-8b6bc9cf-728a-4dc1-a823-a2aae233fd8c tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:19.548724 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-8b6bc9cf-728a-4dc1-a823-a2aae233fd8c tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:19.549153 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-8b6bc9cf-728a-4dc1-a823-a2aae233fd8c tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:19.856871 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e224a840-8b95-42b3-a9fd-11d8b03159c7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:19.857479 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e224a840-8b95-42b3-a9fd-11d8b03159c7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:19.865175 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e224a840-8b95-42b3-a9fd-11d8b03159c7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:19.865658 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e224a840-8b95-42b3-a9fd-11d8b03159c7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:19.866089 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e224a840-8b95-42b3-a9fd-11d8b03159c7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:19.866791 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e224a840-8b95-42b3-a9fd-11d8b03159c7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:19.867237 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e224a840-8b95-42b3-a9fd-11d8b03159c7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:19.868273 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e224a840-8b95-42b3-a9fd-11d8b03159c7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:20.017885 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e224a840-8b95-42b3-a9fd-11d8b03159c7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:20.029428 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e224a840-8b95-42b3-a9fd-11d8b03159c7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:20.031075 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e224a840-8b95-42b3-a9fd-11d8b03159c7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:20.032208 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e224a840-8b95-42b3-a9fd-11d8b03159c7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1407 microversion: 2.20 time: 0.180091 Aug 09 18:53:20.032810 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 284/548] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:53:19 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:53:20.037509 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-58742d85-f7f7-467c-80f0-e4990d8200cb tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:20.038253 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-58742d85-f7f7-467c-80f0-e4990d8200cb tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:20.044738 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-58742d85-f7f7-467c-80f0-e4990d8200cb tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:20.045215 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-58742d85-f7f7-467c-80f0-e4990d8200cb tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:20.045691 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-58742d85-f7f7-467c-80f0-e4990d8200cb tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:20.046401 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-58742d85-f7f7-467c-80f0-e4990d8200cb tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:20.046857 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-58742d85-f7f7-467c-80f0-e4990d8200cb tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:20.047283 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-58742d85-f7f7-467c-80f0-e4990d8200cb tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:20.134672 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-8b6bc9cf-728a-4dc1-a823-a2aae233fd8c tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:20.142519 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-8b6bc9cf-728a-4dc1-a823-a2aae233fd8c tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1673 microversion: 2.1 time: 0.612507 Aug 09 18:53:20.143566 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 265/549] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:19 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1673 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:20.207024 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-58742d85-f7f7-467c-80f0-e4990d8200cb tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:20.216700 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-58742d85-f7f7-467c-80f0-e4990d8200cb tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9" status: 200 len: 1684 microversion: 2.1 time: 0.182803 Aug 09 18:53:20.217287 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 285/550] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:20 2022] GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9 => generated 1684 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:21.058803 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-f5d9f9ee-5d7e-4fbe-b7b5-b340e986f555 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:21.059565 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-f5d9f9ee-5d7e-4fbe-b7b5-b340e986f555 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:21.066212 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f5d9f9ee-5d7e-4fbe-b7b5-b340e986f555 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:21.066700 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f5d9f9ee-5d7e-4fbe-b7b5-b340e986f555 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:21.068224 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f5d9f9ee-5d7e-4fbe-b7b5-b340e986f555 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:21.068949 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f5d9f9ee-5d7e-4fbe-b7b5-b340e986f555 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:21.069451 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f5d9f9ee-5d7e-4fbe-b7b5-b340e986f555 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:21.070042 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f5d9f9ee-5d7e-4fbe-b7b5-b340e986f555 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:21.171001 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-4b705c93-1412-452f-8371-20b9231f94e4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:21.171790 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-4b705c93-1412-452f-8371-20b9231f94e4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:21.180959 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4b705c93-1412-452f-8371-20b9231f94e4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:21.181673 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4b705c93-1412-452f-8371-20b9231f94e4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:21.182113 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4b705c93-1412-452f-8371-20b9231f94e4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:21.182819 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4b705c93-1412-452f-8371-20b9231f94e4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:21.183454 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4b705c93-1412-452f-8371-20b9231f94e4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:21.183972 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4b705c93-1412-452f-8371-20b9231f94e4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:21.249148 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-4b705c93-1412-452f-8371-20b9231f94e4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:21.260308 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-4b705c93-1412-452f-8371-20b9231f94e4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1606 microversion: 2.1 time: 0.093403 Aug 09 18:53:21.261320 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 286/551] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:21 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1606 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:53:21.267234 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-33f7a335-ee49-40aa-9558-7517cebc906a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:21.268084 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-33f7a335-ee49-40aa-9558-7517cebc906a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:21.293331 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-33f7a335-ee49-40aa-9558-7517cebc906a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:21.293331 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-33f7a335-ee49-40aa-9558-7517cebc906a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:21.293331 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-33f7a335-ee49-40aa-9558-7517cebc906a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:21.293331 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-33f7a335-ee49-40aa-9558-7517cebc906a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:21.293673 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-33f7a335-ee49-40aa-9558-7517cebc906a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:21.293673 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-33f7a335-ee49-40aa-9558-7517cebc906a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:21.358712 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-f5d9f9ee-5d7e-4fbe-b7b5-b340e986f555 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:21.368713 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-f5d9f9ee-5d7e-4fbe-b7b5-b340e986f555 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:21.370310 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-f5d9f9ee-5d7e-4fbe-b7b5-b340e986f555 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:21.371855 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-f5d9f9ee-5d7e-4fbe-b7b5-b340e986f555 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1599 microversion: 2.20 time: 0.317533 Aug 09 18:53:21.380845 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 266/552] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:53:21 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1599 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:53:21.385516 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-33f7a335-ee49-40aa-9558-7517cebc906a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:21.397301 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-33f7a335-ee49-40aa-9558-7517cebc906a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9" status: 200 len: 1616 microversion: 2.1 time: 0.134745 Aug 09 18:53:21.397786 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-8d338f1c-58fe-4e01-83af-908cbdc67242 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:21.399674 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 287/553] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:21 2022] GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9 => generated 1616 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:21.400833 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-8d338f1c-58fe-4e01-83af-908cbdc67242 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:21.417221 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-8d338f1c-58fe-4e01-83af-908cbdc67242 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:21.417950 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-8d338f1c-58fe-4e01-83af-908cbdc67242 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:21.418548 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-8d338f1c-58fe-4e01-83af-908cbdc67242 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:21.419456 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-8d338f1c-58fe-4e01-83af-908cbdc67242 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:21.420076 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-8d338f1c-58fe-4e01-83af-908cbdc67242 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:21.420650 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-8d338f1c-58fe-4e01-83af-908cbdc67242 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:21.534072 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-8d338f1c-58fe-4e01-83af-908cbdc67242 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.141285 Aug 09 18:53:21.534984 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 267/554] 10.222.0.57 () {60 vars in 1316 bytes} [Tue Aug 9 18:53:21 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631/os-interface => generated 284 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 18:53:21.585926 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-35653816-8823-4fda-8d90-30d7b9a66adb req-546bc054-290c-4ed1-9d08-7a21b19131f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec125ee9-c66e-4b3d-9304-ef14211241af", "name": "network-vif-deleted", "tag": "f7d1b72c-d7d1-4e45-9a4e-25f70614c7cf"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:53:21.600735 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-35653816-8823-4fda-8d90-30d7b9a66adb req-546bc054-290c-4ed1-9d08-7a21b19131f1 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:21.601433 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-35653816-8823-4fda-8d90-30d7b9a66adb req-546bc054-290c-4ed1-9d08-7a21b19131f1 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:21.602616 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-35653816-8823-4fda-8d90-30d7b9a66adb req-546bc054-290c-4ed1-9d08-7a21b19131f1 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:21.615900 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-35653816-8823-4fda-8d90-30d7b9a66adb req-546bc054-290c-4ed1-9d08-7a21b19131f1 service nova] Creating event network-vif-deleted:f7d1b72c-d7d1-4e45-9a4e-25f70614c7cf for instance ec125ee9-c66e-4b3d-9304-ef14211241af on hv-cinder-82660 Aug 09 18:53:21.622866 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-35653816-8823-4fda-8d90-30d7b9a66adb req-546bc054-290c-4ed1-9d08-7a21b19131f1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040599 Aug 09 18:53:21.626707 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 288/555] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:53:22.283257 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-2b1a3230-c5e8-4792-8551-d475ca36b7a5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:22.284763 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-2b1a3230-c5e8-4792-8551-d475ca36b7a5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:22.291456 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2b1a3230-c5e8-4792-8551-d475ca36b7a5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:22.292115 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2b1a3230-c5e8-4792-8551-d475ca36b7a5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:22.292650 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2b1a3230-c5e8-4792-8551-d475ca36b7a5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:22.293428 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2b1a3230-c5e8-4792-8551-d475ca36b7a5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:22.294000 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2b1a3230-c5e8-4792-8551-d475ca36b7a5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:22.294514 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2b1a3230-c5e8-4792-8551-d475ca36b7a5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:22.337719 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2b1a3230-c5e8-4792-8551-d475ca36b7a5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:22.339152 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2b1a3230-c5e8-4792-8551-d475ca36b7a5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:22.339857 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2b1a3230-c5e8-4792-8551-d475ca36b7a5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:22.340499 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.objects.instance [None req-2b1a3230-c5e8-4792-8551-d475ca36b7a5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lazy-loading 'fault' on Instance uuid ec125ee9-c66e-4b3d-9304-ef14211241af {{(pid=124726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:53:22.393702 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-2b1a3230-c5e8-4792-8551-d475ca36b7a5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:22.402918 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-2b1a3230-c5e8-4792-8551-d475ca36b7a5 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 200 len: 1328 microversion: 2.1 time: 0.124597 Aug 09 18:53:22.405164 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 268/556] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:22 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 1328 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:53:22.422029 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e1806661-d9f7-4e72-b1f7-1546ed651fe8 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:22.422845 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e1806661-d9f7-4e72-b1f7-1546ed651fe8 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:22.430736 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e1806661-d9f7-4e72-b1f7-1546ed651fe8 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:22.431146 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e1806661-d9f7-4e72-b1f7-1546ed651fe8 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:22.431777 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e1806661-d9f7-4e72-b1f7-1546ed651fe8 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:22.432750 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e1806661-d9f7-4e72-b1f7-1546ed651fe8 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:22.433424 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e1806661-d9f7-4e72-b1f7-1546ed651fe8 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:22.434068 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e1806661-d9f7-4e72-b1f7-1546ed651fe8 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:22.476104 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e1806661-d9f7-4e72-b1f7-1546ed651fe8 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:22.477501 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e1806661-d9f7-4e72-b1f7-1546ed651fe8 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:22.478149 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e1806661-d9f7-4e72-b1f7-1546ed651fe8 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:22.478801 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.objects.instance [None req-e1806661-d9f7-4e72-b1f7-1546ed651fe8 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lazy-loading 'fault' on Instance uuid 743aafc6-1787-4c6e-be09-3b460a00d5e9 {{(pid=124725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:53:22.545894 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e1806661-d9f7-4e72-b1f7-1546ed651fe8 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:22.555105 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e1806661-d9f7-4e72-b1f7-1546ed651fe8 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9" status: 200 len: 1332 microversion: 2.1 time: 0.137430 Aug 09 18:53:22.555955 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 289/557] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:22 2022] GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9 => generated 1332 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:22.952217 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-dc80e90f-0ade-4441-9185-0dd8433f5d84 req-d2b0fa7d-d1c6-43b5-b773-b546a989233b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f84c5e3-7213-4bd2-ad7c-4794aab9d631", "tag": "d2e3768b-d787-45b4-941d-9253bd20d687"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:53:22.962807 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-dc80e90f-0ade-4441-9185-0dd8433f5d84 req-d2b0fa7d-d1c6-43b5-b773-b546a989233b service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:22.963315 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-dc80e90f-0ade-4441-9185-0dd8433f5d84 req-d2b0fa7d-d1c6-43b5-b773-b546a989233b service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:22.963747 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-dc80e90f-0ade-4441-9185-0dd8433f5d84 req-d2b0fa7d-d1c6-43b5-b773-b546a989233b service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:22.975287 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-dc80e90f-0ade-4441-9185-0dd8433f5d84 req-d2b0fa7d-d1c6-43b5-b773-b546a989233b service nova] Creating event network-changed:d2e3768b-d787-45b4-941d-9253bd20d687 for instance 8f84c5e3-7213-4bd2-ad7c-4794aab9d631 on hv-cinder-82660 Aug 09 18:53:22.981169 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-dc80e90f-0ade-4441-9185-0dd8433f5d84 req-d2b0fa7d-d1c6-43b5-b773-b546a989233b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032937 Aug 09 18:53:22.984223 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 269/558] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:53:23.427428 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-0c745920-05a9-4bc6-8960-33b3200bfccf tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:23.428029 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-0c745920-05a9-4bc6-8960-33b3200bfccf tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:23.435311 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0c745920-05a9-4bc6-8960-33b3200bfccf tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:23.435801 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0c745920-05a9-4bc6-8960-33b3200bfccf tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:23.436228 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0c745920-05a9-4bc6-8960-33b3200bfccf tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:23.436946 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0c745920-05a9-4bc6-8960-33b3200bfccf tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:23.437460 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0c745920-05a9-4bc6-8960-33b3200bfccf tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:23.438715 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0c745920-05a9-4bc6-8960-33b3200bfccf tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:23.455019 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-0c745920-05a9-4bc6-8960-33b3200bfccf tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] HTTP exception thrown: Instance ec125ee9-c66e-4b3d-9304-ef14211241af could not be found. Aug 09 18:53:23.456692 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-0c745920-05a9-4bc6-8960-33b3200bfccf tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Request method failure captured: Aug 09 18:53:23.456692 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: request: GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af HTTP/1.1 Aug 09 18:53:23.456692 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept: application/json Aug 09 18:53:23.456692 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Aug 09 18:53:23.456692 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Connection: close Aug 09 18:53:23.456692 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Length: 0 Aug 09 18:53:23.456692 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Type: application/json Aug 09 18:53:23.456692 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Host: 10.222.0.57 Aug 09 18:53:23.456692 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Aug 09 18:53:23.456692 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.11 Aug 09 18:53:23.456692 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABi8qwTxTRax9aM0ufQ6Q5l8qgQyMt3EtdYUWO5UjCOxGNgQXIBQ5Gxp-muP_1Q_xy2PVo5H08NH2UqSuyAxgsy9aQYlZC01UkMmzbB3YAhmACqsz02Vu3RHXME3Cgna9lsgPvOKBV_NUzwEFFxtx4Inz6Hxl2HtBb9lm8w16Hp8d9b2Zc Aug 09 18:53:23.456692 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Aug 09 18:53:23.456692 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Aug 09 18:53:23.456692 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Aug 09 18:53:23.456692 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Aug 09 18:53:23.456692 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Aug 09 18:53:23.456692 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Aug 09 18:53:23.456692 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Id: 4d8f60ca836d43399989fb32ad78d27d Aug 09 18:53:23.456692 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-AttachVolumeTestJSON-1718242744 Aug 09 18:53:23.456692 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Role: reader,member Aug 09 18:53:23.456692 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Roles: reader,member Aug 09 18:53:23.459238 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4d8f60ca836d43399989fb32ad78d27d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4d8f60ca836d43399989fb32ad78d27d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4d8f60ca836d43399989fb32ad78d27d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4d8f60ca836d43399989fb32ad78d27d"}]}] Aug 09 18:53:23.459238 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-AttachVolumeTestJSON-1718242744 Aug 09 18:53:23.459238 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 4d8f60ca836d43399989fb32ad78d27d Aug 09 18:53:23.459238 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1718242744 Aug 09 18:53:23.459238 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User: tempest-AttachVolumeTestJSON-1718242744-project Aug 09 18:53:23.459238 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Aug 09 18:53:23.459238 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Aug 09 18:53:23.459238 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Id: a6e48ee30c61424ba0c82ac4fc5cd06c Aug 09 18:53:23.459238 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-AttachVolumeTestJSON-1718242744-project Aug 09 18:53:23.459238 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: method: > Aug 09 18:53:23.459238 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: exception: Instance ec125ee9-c66e-4b3d-9304-ef14211241af could not be found. Aug 09 18:53:23.459238 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: action_args: {'id': 'ec125ee9-c66e-4b3d-9304-ef14211241af'} Aug 09 18:53:23.460407 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:53:23.460407 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:53:23.460407 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:53:23.460407 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:53:23.460407 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:53:23.460407 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:53:23.460407 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:53:23.460407 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:53:23.460407 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:53:23.460407 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:53:23.460407 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec125ee9-c66e-4b3d-9304-ef14211241af could not be found. Aug 09 18:53:23.460407 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:53:23.460407 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:53:23.460407 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:53:23.460407 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:53:23.460407 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:53:23.460407 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:53:23.460407 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:53:23.460407 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:53:23.460407 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:53:23.463587 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:53:23.463587 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:53:23.463587 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:53:23.463587 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:53:23.463587 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:53:23.463587 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:53:23.463587 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:53:23.463587 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec125ee9-c66e-4b3d-9304-ef14211241af could not be found. Aug 09 18:53:23.463587 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:53:23.463587 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:53:23.463587 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:53:23.463587 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:53:23.463587 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:53:23.463587 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:53:23.463587 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:53:23.463587 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:53:23.463587 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec125ee9-c66e-4b3d-9304-ef14211241af could not be found. Aug 09 18:53:23.463587 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:53:23.466013 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-0c745920-05a9-4bc6-8960-33b3200bfccf tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Returning 404 to user: Instance ec125ee9-c66e-4b3d-9304-ef14211241af could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:53:23.466013 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-0c745920-05a9-4bc6-8960-33b3200bfccf tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 404 len: 111 microversion: 2.1 time: 0.034754 Aug 09 18:53:23.466013 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 290/559] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:23 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:53:23.468701 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-a615aac5-4b9e-403f-943a-27faf47d8e6e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '.version_select at 0x7f8d69dac5e0>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:23.555795 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-a615aac5-4b9e-403f-943a-27faf47d8e6e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2062690512" status: 202 len: 0 microversion: 2.1 time: 0.091411 Aug 09 18:53:23.556574 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 270/560] 10.222.0.57 () {58 vars in 1221 bytes} [Tue Aug 9 18:53:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2062690512 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:53:23.582184 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c8787014-72a9-41a4-a1b8-82c4683a1ba5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:23.583104 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-c8787014-72a9-41a4-a1b8-82c4683a1ba5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:23.594284 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c8787014-72a9-41a4-a1b8-82c4683a1ba5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:23.596126 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c8787014-72a9-41a4-a1b8-82c4683a1ba5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:23.596126 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c8787014-72a9-41a4-a1b8-82c4683a1ba5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:23.596126 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c8787014-72a9-41a4-a1b8-82c4683a1ba5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:23.596873 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c8787014-72a9-41a4-a1b8-82c4683a1ba5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:23.597441 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c8787014-72a9-41a4-a1b8-82c4683a1ba5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:23.616173 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-c8787014-72a9-41a4-a1b8-82c4683a1ba5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] HTTP exception thrown: Instance 743aafc6-1787-4c6e-be09-3b460a00d5e9 could not be found. Aug 09 18:53:23.618625 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c8787014-72a9-41a4-a1b8-82c4683a1ba5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Request method failure captured: Aug 09 18:53:23.618625 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: request: GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9 HTTP/1.1 Aug 09 18:53:23.618625 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept: application/json Aug 09 18:53:23.618625 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Aug 09 18:53:23.618625 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Connection: close Aug 09 18:53:23.618625 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Length: 0 Aug 09 18:53:23.618625 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Type: application/json Aug 09 18:53:23.618625 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Host: 10.222.0.57 Aug 09 18:53:23.618625 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Aug 09 18:53:23.618625 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.11 Aug 09 18:53:23.618625 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABi8qxu6GlCXsghs7mXHsJ6lMdriR0lCN6zx0jJtIVa-hoSSpRyn9kABjaS5Ya_Ocw2sU0SEZSB-MC5jyn7nC01Qf-R3Wxc4u_OmCKdxSmXeuRuDoxnEqYVjV6mxSKvywrengnzW8AvtzIMJfiluX7W9B1UousoG9Ld7Q7tERFPOMWrYmI Aug 09 18:53:23.618625 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Aug 09 18:53:23.618625 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Aug 09 18:53:23.618625 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Aug 09 18:53:23.618625 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Aug 09 18:53:23.618625 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Aug 09 18:53:23.618625 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Aug 09 18:53:23.618625 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Id: 4a745db383cb452187f7c82b9977c09b Aug 09 18:53:23.618625 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-AttachVolumeNegativeTest-1856281892 Aug 09 18:53:23.618625 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Role: reader,member Aug 09 18:53:23.618625 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Roles: reader,member Aug 09 18:53:23.620115 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4a745db383cb452187f7c82b9977c09b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a745db383cb452187f7c82b9977c09b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4a745db383cb452187f7c82b9977c09b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a745db383cb452187f7c82b9977c09b"}]}] Aug 09 18:53:23.620115 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-AttachVolumeNegativeTest-1856281892 Aug 09 18:53:23.620115 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 4a745db383cb452187f7c82b9977c09b Aug 09 18:53:23.620115 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1856281892 Aug 09 18:53:23.620115 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User: tempest-AttachVolumeNegativeTest-1856281892-project Aug 09 18:53:23.620115 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Aug 09 18:53:23.620115 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Aug 09 18:53:23.620115 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Id: 00491255f4b44125b6dc9f816c9bbb58 Aug 09 18:53:23.620115 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-AttachVolumeNegativeTest-1856281892-project Aug 09 18:53:23.620115 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: method: > Aug 09 18:53:23.620115 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: exception: Instance 743aafc6-1787-4c6e-be09-3b460a00d5e9 could not be found. Aug 09 18:53:23.620115 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: action_args: {'id': '743aafc6-1787-4c6e-be09-3b460a00d5e9'} Aug 09 18:53:23.621044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:53:23.621044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:53:23.621044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:53:23.621044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:53:23.621044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:53:23.621044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:53:23.621044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:53:23.621044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:53:23.621044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:53:23.621044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:53:23.621044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 743aafc6-1787-4c6e-be09-3b460a00d5e9 could not be found. Aug 09 18:53:23.621044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:53:23.621044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:53:23.621044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:53:23.621044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:53:23.621044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:53:23.621044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:53:23.621044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:53:23.621044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:53:23.621044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:53:23.625844 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:53:23.625844 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:53:23.625844 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:53:23.625844 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:53:23.625844 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:53:23.625844 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:53:23.625844 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:53:23.625844 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 743aafc6-1787-4c6e-be09-3b460a00d5e9 could not be found. Aug 09 18:53:23.625844 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:53:23.625844 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:53:23.625844 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:53:23.625844 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:53:23.625844 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:53:23.625844 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:53:23.625844 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:53:23.625844 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:53:23.625844 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 743aafc6-1787-4c6e-be09-3b460a00d5e9 could not be found. Aug 09 18:53:23.625844 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:53:23.627910 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c8787014-72a9-41a4-a1b8-82c4683a1ba5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Returning 404 to user: Instance 743aafc6-1787-4c6e-be09-3b460a00d5e9 could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:53:23.627910 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-c8787014-72a9-41a4-a1b8-82c4683a1ba5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9" status: 404 len: 111 microversion: 2.1 time: 0.047918 Aug 09 18:53:23.627910 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 291/561] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:23 2022] GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:53:23.635692 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-e7bbf056-2b6d-4f54-bcdd-983e410de6df tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '.version_select at 0x7f8d69d59040>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:23.659110 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-d5fabfb6-d813-49eb-acbc-fcafe6129940 req-c0570cec-4e4d-4e4c-8ca3-6997e93cdc3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "743aafc6-1787-4c6e-be09-3b460a00d5e9", "name": "network-vif-deleted", "tag": "2a32c700-6fce-4e74-b894-56a5eba16aed"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:53:23.671702 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-d5fabfb6-d813-49eb-acbc-fcafe6129940 req-c0570cec-4e4d-4e4c-8ca3-6997e93cdc3b service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:23.676576 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-d5fabfb6-d813-49eb-acbc-fcafe6129940 req-c0570cec-4e4d-4e4c-8ca3-6997e93cdc3b service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:23.676576 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-d5fabfb6-d813-49eb-acbc-fcafe6129940 req-c0570cec-4e4d-4e4c-8ca3-6997e93cdc3b service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:23.685873 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-d5fabfb6-d813-49eb-acbc-fcafe6129940 req-c0570cec-4e4d-4e4c-8ca3-6997e93cdc3b service nova] Creating event network-vif-deleted:2a32c700-6fce-4e74-b894-56a5eba16aed for instance 743aafc6-1787-4c6e-be09-3b460a00d5e9 on hv-cinder-82660 Aug 09 18:53:23.691619 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-d5fabfb6-d813-49eb-acbc-fcafe6129940 req-c0570cec-4e4d-4e4c-8ca3-6997e93cdc3b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037695 Aug 09 18:53:23.692877 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 292/562] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:53:23.727398 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-e7bbf056-2b6d-4f54-bcdd-983e410de6df tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1157083449" status: 202 len: 0 microversion: 2.1 time: 0.098000 Aug 09 18:53:23.728837 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 271/563] 10.222.0.57 () {58 vars in 1221 bytes} [Tue Aug 9 18:53:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1157083449 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:53:24.493562 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b8123eba-46a2-4bfa-a7a3-901af1d71ade tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Action: 'create', calling method: .version_select at 0x7f8d6958bca0>, body: {"keypair": {"name": "tempest-keypair-1892100696", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUBHC9a0TBe1MJXm05vpVvg/btX3zZEUK23rBL2dBEAYOskzyUZYZLWV+akb8Hy4g/W6f3PIbyuI7y3Cx8xq/wB/NlfGJzGauNH6PXFnRGV8kF4uCBD+bxzb+/NEppfKw=="}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:53:24.511332 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-b8123eba-46a2-4bfa-a7a3-901af1d71ade tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Getting quotas for project 4d8f60ca836d43399989fb32ad78d27d. Resources: {'key_pairs'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:53:24.515832 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-b8123eba-46a2-4bfa-a7a3-901af1d71ade tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Getting quotas for user a6e48ee30c61424ba0c82ac4fc5cd06c and project 4d8f60ca836d43399989fb32ad78d27d. Resources: {'key_pairs'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:53:24.632865 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-b8123eba-46a2-4bfa-a7a3-901af1d71ade tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.144563 Aug 09 18:53:24.633545 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 293/564] 10.222.0.57 () {60 vars in 1159 bytes} [Tue Aug 9 18:53:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:53:24.727705 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-6d3f0889-62e0-44fd-a231-d6a39c8426e1 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Action: 'create', calling method: .version_select at 0x7f8d69c7eee0>, body: {"keypair": {"name": "tempest-keypair-576777891", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ5vJlcy7hblqdPsoIbVGB9RoyPf7aQdRhTk8IaTfHVnbOKdf9teMcFGnmf9TUTxxIq5RqDHGSuRXKmITxnQnxghqtARzrRjlqoN4WbTM29/71V0eT056LEYPWs5K1MzEw=="}} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:53:24.743951 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.quota [None req-6d3f0889-62e0-44fd-a231-d6a39c8426e1 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Getting quotas for project 4a745db383cb452187f7c82b9977c09b. Resources: {'key_pairs'} {{(pid=124726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:53:24.747902 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.quota [None req-6d3f0889-62e0-44fd-a231-d6a39c8426e1 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Getting quotas for user 00491255f4b44125b6dc9f816c9bbb58 and project 4a745db383cb452187f7c82b9977c09b. Resources: {'key_pairs'} {{(pid=124726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:53:24.848798 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-6d3f0889-62e0-44fd-a231-d6a39c8426e1 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.125885 Aug 09 18:53:24.849403 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 272/565] 10.222.0.57 () {60 vars in 1159 bytes} [Tue Aug 9 18:53:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:53:27.223651 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-2d597ec6-7b04-4215-a6d8-a6b41af7d41b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1032978159", "imageRef": "124dd477-ccfa-4be3-9973-6b1f33b47df8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e7858aa7-cff3-45e7-8595-598238cb5ae7"}], "security_groups": [{"name": "tempest-securitygroup--761809025"}], "key_name": "tempest-keypair-1892100696", "user_data": "}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:53:27.267198 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-4ca7d368-beb2-45ba-897e-8f4ce01f5a61 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1887399006", "imageRef": "124dd477-ccfa-4be3-9973-6b1f33b47df8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c83a464f-4efd-4554-9508-d2b73d3a8a45"}], "security_groups": [{"name": "tempest-securitygroup--1762949337"}], "key_name": "tempest-keypair-576777891", "user_data": "}} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:53:27.336063 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.network.neutron [None req-2d597ec6-7b04-4215-a6d8-a6b41af7d41b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] validate_networks() for [('e7858aa7-cff3-45e7-8595-598238cb5ae7', None, None, None, None, None)] {{(pid=124725) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:53:27.373886 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.network.neutron [None req-4ca7d368-beb2-45ba-897e-8f4ce01f5a61 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] validate_networks() for [('c83a464f-4efd-4554-9508-d2b73d3a8a45', None, None, None, None, None)] {{(pid=124726) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:53:27.755191 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.virt.hardware [None req-4ca7d368-beb2-45ba-897e-8f4ce01f5a61 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Flavor limits 0:0:0 {{(pid=124726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:53:27.755739 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.virt.hardware [None req-4ca7d368-beb2-45ba-897e-8f4ce01f5a61 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Image limits 0:0:0 {{(pid=124726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:53:27.756301 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.virt.hardware [None req-4ca7d368-beb2-45ba-897e-8f4ce01f5a61 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Flavor pref 0:0:0 {{(pid=124726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:53:27.756714 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.virt.hardware [None req-4ca7d368-beb2-45ba-897e-8f4ce01f5a61 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Image pref 0:0:0 {{(pid=124726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:53:27.757122 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.virt.hardware [None req-4ca7d368-beb2-45ba-897e-8f4ce01f5a61 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:53:27.766889 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4ca7d368-beb2-45ba-897e-8f4ce01f5a61 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:27.767372 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4ca7d368-beb2-45ba-897e-8f4ce01f5a61 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:27.767802 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4ca7d368-beb2-45ba-897e-8f4ce01f5a61 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:27.768522 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4ca7d368-beb2-45ba-897e-8f4ce01f5a61 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:27.768970 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4ca7d368-beb2-45ba-897e-8f4ce01f5a61 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:27.769596 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4ca7d368-beb2-45ba-897e-8f4ce01f5a61 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:27.788391 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.quota [None req-4ca7d368-beb2-45ba-897e-8f4ce01f5a61 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Getting quotas for project 4a745db383cb452187f7c82b9977c09b. Resources: {'cores', 'ram', 'instances'} {{(pid=124726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:53:27.793641 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.quota [None req-4ca7d368-beb2-45ba-897e-8f4ce01f5a61 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Getting quotas for user 00491255f4b44125b6dc9f816c9bbb58 and project 4a745db383cb452187f7c82b9977c09b. Resources: {'cores', 'ram', 'instances'} {{(pid=124726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:53:27.805967 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-4ca7d368-beb2-45ba-897e-8f4ce01f5a61 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Going to run 1 instances... {{(pid=124726) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:53:27.808415 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-4ca7d368-beb2-45ba-897e-8f4ce01f5a61 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 98218676-0e95-45b0-877f-4b0f7107048c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='124dd477-ccfa-4be3-9973-6b1f33b47df8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:53:27.923568 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-2d597ec6-7b04-4215-a6d8-a6b41af7d41b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Flavor limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:53:27.923995 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-2d597ec6-7b04-4215-a6d8-a6b41af7d41b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Image limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:53:27.924470 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-2d597ec6-7b04-4215-a6d8-a6b41af7d41b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Flavor pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:53:27.924883 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-2d597ec6-7b04-4215-a6d8-a6b41af7d41b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Image pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:53:27.925295 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-2d597ec6-7b04-4215-a6d8-a6b41af7d41b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:53:27.934999 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2d597ec6-7b04-4215-a6d8-a6b41af7d41b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:27.935697 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2d597ec6-7b04-4215-a6d8-a6b41af7d41b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:27.936125 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2d597ec6-7b04-4215-a6d8-a6b41af7d41b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:27.936917 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2d597ec6-7b04-4215-a6d8-a6b41af7d41b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:27.937481 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2d597ec6-7b04-4215-a6d8-a6b41af7d41b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:27.937925 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2d597ec6-7b04-4215-a6d8-a6b41af7d41b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:27.954578 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-2d597ec6-7b04-4215-a6d8-a6b41af7d41b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Getting quotas for project 4d8f60ca836d43399989fb32ad78d27d. Resources: {'cores', 'ram', 'instances'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:53:27.958903 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-2d597ec6-7b04-4215-a6d8-a6b41af7d41b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Getting quotas for user a6e48ee30c61424ba0c82ac4fc5cd06c and project 4d8f60ca836d43399989fb32ad78d27d. Resources: {'cores', 'ram', 'instances'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:53:27.970247 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-2d597ec6-7b04-4215-a6d8-a6b41af7d41b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Going to run 1 instances... {{(pid=124725) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:53:27.972593 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-2d597ec6-7b04-4215-a6d8-a6b41af7d41b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ece2efc3-8ca5-4b96-93cb-42f4065610c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='124dd477-ccfa-4be3-9973-6b1f33b47df8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:53:27.991591 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-4ca7d368-beb2-45ba-897e-8f4ce01f5a61 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.729613 Aug 09 18:53:27.997672 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 273/566] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 9 18:53:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 18:53:28.002913 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-111f6d9b-4081-4b69-ab18-c3b1e125de6b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:28.003510 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-111f6d9b-4081-4b69-ab18-c3b1e125de6b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 98218676-0e95-45b0-877f-4b0f7107048c] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:28.062133 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-111f6d9b-4081-4b69-ab18-c3b1e125de6b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:28.069016 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-111f6d9b-4081-4b69-ab18-c3b1e125de6b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c" status: 200 len: 1241 microversion: 2.1 time: 0.069859 Aug 09 18:53:28.069620 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 274/567] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:27 2022] GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:53:28.110055 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-2d597ec6-7b04-4215-a6d8-a6b41af7d41b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.891362 Aug 09 18:53:28.111015 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 294/568] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 9 18:53:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:53:28.123267 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-efcb968e-edea-4891-a0e1-efa7e3bea861 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:28.123947 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-efcb968e-edea-4891-a0e1-efa7e3bea861 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ece2efc3-8ca5-4b96-93cb-42f4065610c6] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:28.184541 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-efcb968e-edea-4891-a0e1-efa7e3bea861 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:28.194041 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-efcb968e-edea-4891-a0e1-efa7e3bea861 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6" status: 200 len: 1238 microversion: 2.1 time: 0.076111 Aug 09 18:53:28.194644 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 275/569] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:28 2022] GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6 => generated 1238 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:29.091722 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-1e8af90e-2daa-43e0-995f-435eaa36e9d0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:29.092273 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-1e8af90e-2daa-43e0-995f-435eaa36e9d0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 98218676-0e95-45b0-877f-4b0f7107048c] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:29.098910 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1e8af90e-2daa-43e0-995f-435eaa36e9d0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:29.099381 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1e8af90e-2daa-43e0-995f-435eaa36e9d0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:29.099878 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1e8af90e-2daa-43e0-995f-435eaa36e9d0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:29.100571 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1e8af90e-2daa-43e0-995f-435eaa36e9d0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:29.101016 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1e8af90e-2daa-43e0-995f-435eaa36e9d0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:29.101431 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1e8af90e-2daa-43e0-995f-435eaa36e9d0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:29.122329 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:53:29.165897 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1e8af90e-2daa-43e0-995f-435eaa36e9d0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:29.174158 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-1e8af90e-2daa-43e0-995f-435eaa36e9d0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c" status: 200 len: 1245 microversion: 2.1 time: 0.087681 Aug 09 18:53:29.174750 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 295/570] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:29 2022] GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:29.216064 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-73e44da1-d515-46b2-be37-15d320b71380 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:29.217143 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-73e44da1-d515-46b2-be37-15d320b71380 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ece2efc3-8ca5-4b96-93cb-42f4065610c6] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:29.232479 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-73e44da1-d515-46b2-be37-15d320b71380 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:29.232966 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-73e44da1-d515-46b2-be37-15d320b71380 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:29.233398 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-73e44da1-d515-46b2-be37-15d320b71380 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:29.234132 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-73e44da1-d515-46b2-be37-15d320b71380 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:29.234584 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-73e44da1-d515-46b2-be37-15d320b71380 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:29.237770 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-73e44da1-d515-46b2-be37-15d320b71380 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:29.300719 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-73e44da1-d515-46b2-be37-15d320b71380 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:29.309183 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-73e44da1-d515-46b2-be37-15d320b71380 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6" status: 200 len: 1242 microversion: 2.1 time: 0.097524 Aug 09 18:53:29.309851 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 276/571] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:29 2022] GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6 => generated 1242 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:30.195120 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-1fdacca9-b2b0-47d9-86e8-e7e2bf9d5e4b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:30.195728 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-1fdacca9-b2b0-47d9-86e8-e7e2bf9d5e4b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 98218676-0e95-45b0-877f-4b0f7107048c] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:30.203278 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1fdacca9-b2b0-47d9-86e8-e7e2bf9d5e4b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:30.204594 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1fdacca9-b2b0-47d9-86e8-e7e2bf9d5e4b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:30.204594 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1fdacca9-b2b0-47d9-86e8-e7e2bf9d5e4b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:30.204930 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1fdacca9-b2b0-47d9-86e8-e7e2bf9d5e4b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:30.205386 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1fdacca9-b2b0-47d9-86e8-e7e2bf9d5e4b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:30.205840 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1fdacca9-b2b0-47d9-86e8-e7e2bf9d5e4b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:30.268274 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1fdacca9-b2b0-47d9-86e8-e7e2bf9d5e4b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:30.275721 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-1fdacca9-b2b0-47d9-86e8-e7e2bf9d5e4b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c" status: 200 len: 1311 microversion: 2.1 time: 0.084941 Aug 09 18:53:30.276288 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 296/572] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:30 2022] GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c => generated 1311 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:30.330636 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-f89f0843-9405-43d2-a0c2-70a880aa0d6e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:30.331407 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-f89f0843-9405-43d2-a0c2-70a880aa0d6e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ece2efc3-8ca5-4b96-93cb-42f4065610c6] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:30.339096 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f89f0843-9405-43d2-a0c2-70a880aa0d6e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:30.339571 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f89f0843-9405-43d2-a0c2-70a880aa0d6e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:30.339996 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f89f0843-9405-43d2-a0c2-70a880aa0d6e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:30.340678 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f89f0843-9405-43d2-a0c2-70a880aa0d6e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:30.341464 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f89f0843-9405-43d2-a0c2-70a880aa0d6e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:30.341910 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f89f0843-9405-43d2-a0c2-70a880aa0d6e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:30.437552 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-f89f0843-9405-43d2-a0c2-70a880aa0d6e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:30.444992 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-f89f0843-9405-43d2-a0c2-70a880aa0d6e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6" status: 200 len: 1290 microversion: 2.1 time: 0.118199 Aug 09 18:53:30.445782 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 277/573] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:30 2022] GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6 => generated 1290 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:31.302858 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-270b99a1-37fe-47e0-9a88-cddbd54ae869 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:31.304028 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-270b99a1-37fe-47e0-9a88-cddbd54ae869 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 98218676-0e95-45b0-877f-4b0f7107048c] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:31.311524 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-270b99a1-37fe-47e0-9a88-cddbd54ae869 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:31.312278 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-270b99a1-37fe-47e0-9a88-cddbd54ae869 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:31.313072 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-270b99a1-37fe-47e0-9a88-cddbd54ae869 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:31.313829 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-270b99a1-37fe-47e0-9a88-cddbd54ae869 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:31.314291 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-270b99a1-37fe-47e0-9a88-cddbd54ae869 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:31.314718 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-270b99a1-37fe-47e0-9a88-cddbd54ae869 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:31.466732 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-270b99a1-37fe-47e0-9a88-cddbd54ae869 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:31.467094 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-c6640356-0f4a-4695-bba1-4191405239f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:31.467710 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-c6640356-0f4a-4695-bba1-4191405239f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ece2efc3-8ca5-4b96-93cb-42f4065610c6] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:31.476711 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-270b99a1-37fe-47e0-9a88-cddbd54ae869 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c" status: 200 len: 1367 microversion: 2.1 time: 0.183501 Aug 09 18:53:31.477630 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 297/574] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:31 2022] GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:31.480122 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c6640356-0f4a-4695-bba1-4191405239f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:31.480867 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c6640356-0f4a-4695-bba1-4191405239f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:31.481579 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c6640356-0f4a-4695-bba1-4191405239f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:31.482644 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c6640356-0f4a-4695-bba1-4191405239f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:31.483313 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c6640356-0f4a-4695-bba1-4191405239f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:31.483961 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c6640356-0f4a-4695-bba1-4191405239f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:31.564958 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-c6640356-0f4a-4695-bba1-4191405239f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:31.572294 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-c6640356-0f4a-4695-bba1-4191405239f9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6" status: 200 len: 1296 microversion: 2.1 time: 0.109048 Aug 09 18:53:31.572861 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 278/575] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:31 2022] GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6 => generated 1296 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:53:32.407949 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-f5cee61d-d609-4aae-a735-b24638a78e52 req-4d6458ac-43b9-4f2a-afaf-8543fc7ad403 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98218676-0e95-45b0-877f-4b0f7107048c", "tag": "0bb8e403-067a-402f-a488-981ea17677b8"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:53:32.418112 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-f5cee61d-d609-4aae-a735-b24638a78e52 req-4d6458ac-43b9-4f2a-afaf-8543fc7ad403 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:32.418922 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-f5cee61d-d609-4aae-a735-b24638a78e52 req-4d6458ac-43b9-4f2a-afaf-8543fc7ad403 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:32.419507 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-f5cee61d-d609-4aae-a735-b24638a78e52 req-4d6458ac-43b9-4f2a-afaf-8543fc7ad403 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:32.431294 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-f5cee61d-d609-4aae-a735-b24638a78e52 req-4d6458ac-43b9-4f2a-afaf-8543fc7ad403 service nova] Creating event network-changed:0bb8e403-067a-402f-a488-981ea17677b8 for instance 98218676-0e95-45b0-877f-4b0f7107048c on hv-cinder-82660 Aug 09 18:53:32.436271 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-f5cee61d-d609-4aae-a735-b24638a78e52 req-4d6458ac-43b9-4f2a-afaf-8543fc7ad403 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032686 Aug 09 18:53:32.437053 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 298/576] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:53:32.499083 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-3afe18ad-1945-443f-8c42-f2e098db53dc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:32.499821 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-3afe18ad-1945-443f-8c42-f2e098db53dc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 98218676-0e95-45b0-877f-4b0f7107048c] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:32.506535 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3afe18ad-1945-443f-8c42-f2e098db53dc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:32.507013 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3afe18ad-1945-443f-8c42-f2e098db53dc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:32.507440 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3afe18ad-1945-443f-8c42-f2e098db53dc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:32.508122 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3afe18ad-1945-443f-8c42-f2e098db53dc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:32.508571 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3afe18ad-1945-443f-8c42-f2e098db53dc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:32.508986 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3afe18ad-1945-443f-8c42-f2e098db53dc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:32.592963 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-81243af5-7f57-4c64-afd8-e94b58803b9b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:32.593742 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-81243af5-7f57-4c64-afd8-e94b58803b9b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ece2efc3-8ca5-4b96-93cb-42f4065610c6] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:32.599978 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-81243af5-7f57-4c64-afd8-e94b58803b9b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:32.600461 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-81243af5-7f57-4c64-afd8-e94b58803b9b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:32.600898 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-81243af5-7f57-4c64-afd8-e94b58803b9b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:32.601617 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-81243af5-7f57-4c64-afd8-e94b58803b9b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:32.602071 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-81243af5-7f57-4c64-afd8-e94b58803b9b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:32.602495 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-81243af5-7f57-4c64-afd8-e94b58803b9b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:32.747366 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-81243af5-7f57-4c64-afd8-e94b58803b9b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:32.754803 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-81243af5-7f57-4c64-afd8-e94b58803b9b tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6" status: 200 len: 1363 microversion: 2.1 time: 0.166246 Aug 09 18:53:32.755744 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 299/577] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:32 2022] GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:53:32.829010 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-3afe18ad-1945-443f-8c42-f2e098db53dc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:32.836698 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-3afe18ad-1945-443f-8c42-f2e098db53dc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c" status: 200 len: 1367 microversion: 2.1 time: 0.341488 Aug 09 18:53:32.849544 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 279/578] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:32 2022] GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c => generated 1367 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:33.775310 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-6236fad4-8783-4901-bc93-1245e813f389 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:33.776573 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-6236fad4-8783-4901-bc93-1245e813f389 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ece2efc3-8ca5-4b96-93cb-42f4065610c6] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:33.782894 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6236fad4-8783-4901-bc93-1245e813f389 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:33.783378 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6236fad4-8783-4901-bc93-1245e813f389 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:33.783808 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6236fad4-8783-4901-bc93-1245e813f389 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:33.784498 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6236fad4-8783-4901-bc93-1245e813f389 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:33.785131 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6236fad4-8783-4901-bc93-1245e813f389 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:33.785578 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6236fad4-8783-4901-bc93-1245e813f389 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:33.858782 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-d64224be-90ab-4db8-a276-98c191b6b7f2 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:33.859572 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-d64224be-90ab-4db8-a276-98c191b6b7f2 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 98218676-0e95-45b0-877f-4b0f7107048c] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:33.866267 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d64224be-90ab-4db8-a276-98c191b6b7f2 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:33.866785 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d64224be-90ab-4db8-a276-98c191b6b7f2 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:33.867576 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d64224be-90ab-4db8-a276-98c191b6b7f2 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:33.867931 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d64224be-90ab-4db8-a276-98c191b6b7f2 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:33.869059 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d64224be-90ab-4db8-a276-98c191b6b7f2 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:33.869479 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d64224be-90ab-4db8-a276-98c191b6b7f2 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:33.933996 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-6236fad4-8783-4901-bc93-1245e813f389 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:33.941533 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-6236fad4-8783-4901-bc93-1245e813f389 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6" status: 200 len: 1363 microversion: 2.1 time: 0.170172 Aug 09 18:53:33.942187 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 300/579] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:33 2022] GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:34.039797 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-d64224be-90ab-4db8-a276-98c191b6b7f2 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:34.047663 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-d64224be-90ab-4db8-a276-98c191b6b7f2 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c" status: 200 len: 1367 microversion: 2.1 time: 0.192849 Aug 09 18:53:34.048229 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 280/580] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:33 2022] GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:53:34.451204 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-5697296b-5fbd-478e-972d-dbdb0a2a13f5 req-d40f2eac-c0fb-4a1f-a4b0-aa5e2109c61f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ece2efc3-8ca5-4b96-93cb-42f4065610c6", "tag": "f68a90d2-e740-4361-a743-b3af796112d5"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:53:34.460369 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-5697296b-5fbd-478e-972d-dbdb0a2a13f5 req-d40f2eac-c0fb-4a1f-a4b0-aa5e2109c61f service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:34.460839 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-5697296b-5fbd-478e-972d-dbdb0a2a13f5 req-d40f2eac-c0fb-4a1f-a4b0-aa5e2109c61f service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:34.461264 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-5697296b-5fbd-478e-972d-dbdb0a2a13f5 req-d40f2eac-c0fb-4a1f-a4b0-aa5e2109c61f service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:34.471806 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-5697296b-5fbd-478e-972d-dbdb0a2a13f5 req-d40f2eac-c0fb-4a1f-a4b0-aa5e2109c61f service nova] Creating event network-changed:f68a90d2-e740-4361-a743-b3af796112d5 for instance ece2efc3-8ca5-4b96-93cb-42f4065610c6 on hv-cinder-82660 Aug 09 18:53:34.476461 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-5697296b-5fbd-478e-972d-dbdb0a2a13f5 req-d40f2eac-c0fb-4a1f-a4b0-aa5e2109c61f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029568 Aug 09 18:53:34.477023 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 301/581] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:53:34.963615 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-0b96bc82-eed8-454e-b392-5a6d26941f7e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:34.964222 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-0b96bc82-eed8-454e-b392-5a6d26941f7e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ece2efc3-8ca5-4b96-93cb-42f4065610c6] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:34.970687 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0b96bc82-eed8-454e-b392-5a6d26941f7e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:34.971168 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0b96bc82-eed8-454e-b392-5a6d26941f7e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:34.971599 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0b96bc82-eed8-454e-b392-5a6d26941f7e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:34.972291 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0b96bc82-eed8-454e-b392-5a6d26941f7e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:34.972741 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0b96bc82-eed8-454e-b392-5a6d26941f7e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:34.973189 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0b96bc82-eed8-454e-b392-5a6d26941f7e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:35.070122 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-7f7f10d7-a2c8-4de0-869f-7c0de01001cb tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:35.070821 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-7f7f10d7-a2c8-4de0-869f-7c0de01001cb tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 98218676-0e95-45b0-877f-4b0f7107048c] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:35.077668 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7f7f10d7-a2c8-4de0-869f-7c0de01001cb tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:35.078153 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7f7f10d7-a2c8-4de0-869f-7c0de01001cb tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:35.078589 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7f7f10d7-a2c8-4de0-869f-7c0de01001cb tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:35.079287 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7f7f10d7-a2c8-4de0-869f-7c0de01001cb tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:35.079743 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7f7f10d7-a2c8-4de0-869f-7c0de01001cb tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:35.080167 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7f7f10d7-a2c8-4de0-869f-7c0de01001cb tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:35.115291 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-0b96bc82-eed8-454e-b392-5a6d26941f7e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:35.123420 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-0b96bc82-eed8-454e-b392-5a6d26941f7e tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6" status: 200 len: 1363 microversion: 2.1 time: 0.163650 Aug 09 18:53:35.123999 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 281/582] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:34 2022] GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:35.214064 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-7f7f10d7-a2c8-4de0-869f-7c0de01001cb tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:35.221477 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-7f7f10d7-a2c8-4de0-869f-7c0de01001cb tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c" status: 200 len: 1367 microversion: 2.1 time: 0.156041 Aug 09 18:53:35.222040 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 302/583] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:35 2022] GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:53:36.033224 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-28bdff26-246d-46ef-b16e-5e6af6851736 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:53:36.033809 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-28bdff26-246d-46ef-b16e-5e6af6851736 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:36.040791 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-28bdff26-246d-46ef-b16e-5e6af6851736 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:36.042025 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-28bdff26-246d-46ef-b16e-5e6af6851736 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:36.042459 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-28bdff26-246d-46ef-b16e-5e6af6851736 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:36.043783 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-28bdff26-246d-46ef-b16e-5e6af6851736 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:36.044240 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-28bdff26-246d-46ef-b16e-5e6af6851736 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:36.044659 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-28bdff26-246d-46ef-b16e-5e6af6851736 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:36.067439 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.objects.instance [None req-28bdff26-246d-46ef-b16e-5e6af6851736 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lazy-loading 'flavor' on Instance uuid fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 {{(pid=124726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:53:36.086953 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:53:36.151955 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-9dcd5ded-129a-45bc-be9b-a6403b7dbce4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:36.152606 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-9dcd5ded-129a-45bc-be9b-a6403b7dbce4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ece2efc3-8ca5-4b96-93cb-42f4065610c6] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:36.159432 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9dcd5ded-129a-45bc-be9b-a6403b7dbce4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:36.160117 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9dcd5ded-129a-45bc-be9b-a6403b7dbce4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:36.160554 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9dcd5ded-129a-45bc-be9b-a6403b7dbce4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:36.161259 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9dcd5ded-129a-45bc-be9b-a6403b7dbce4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:36.161756 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9dcd5ded-129a-45bc-be9b-a6403b7dbce4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:36.162182 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9dcd5ded-129a-45bc-be9b-a6403b7dbce4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:36.322257 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-9dcd5ded-129a-45bc-be9b-a6403b7dbce4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:36.330045 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-9dcd5ded-129a-45bc-be9b-a6403b7dbce4 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6" status: 200 len: 1363 microversion: 2.1 time: 0.182404 Aug 09 18:53:36.344503 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 303/584] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:36 2022] GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6 => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:53:36.350217 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-8fb8d99b-b369-4ab3-b86e-3a59e87a7044 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:36.351287 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-8fb8d99b-b369-4ab3-b86e-3a59e87a7044 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 98218676-0e95-45b0-877f-4b0f7107048c] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:36.357950 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8fb8d99b-b369-4ab3-b86e-3a59e87a7044 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:36.358798 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8fb8d99b-b369-4ab3-b86e-3a59e87a7044 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:36.359441 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8fb8d99b-b369-4ab3-b86e-3a59e87a7044 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:36.360356 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8fb8d99b-b369-4ab3-b86e-3a59e87a7044 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:36.363049 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8fb8d99b-b369-4ab3-b86e-3a59e87a7044 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:36.363960 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8fb8d99b-b369-4ab3-b86e-3a59e87a7044 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:36.414793 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-28bdff26-246d-46ef-b16e-5e6af6851736 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "POST /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7/action" status: 202 len: 0 microversion: 2.1 time: 0.385223 Aug 09 18:53:36.415406 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 282/585] 10.222.0.57 () {60 vars in 1278 bytes} [Tue Aug 9 18:53:36 2022] POST /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7/action => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:53:36.424051 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-85275c59-32ab-4c1b-9cad-a0d9e5b14d23 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:36.425025 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-85275c59-32ab-4c1b-9cad-a0d9e5b14d23 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:36.431897 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-85275c59-32ab-4c1b-9cad-a0d9e5b14d23 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:36.432618 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-85275c59-32ab-4c1b-9cad-a0d9e5b14d23 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:36.434648 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-85275c59-32ab-4c1b-9cad-a0d9e5b14d23 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:36.434648 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-85275c59-32ab-4c1b-9cad-a0d9e5b14d23 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:36.434648 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-85275c59-32ab-4c1b-9cad-a0d9e5b14d23 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:36.434648 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-85275c59-32ab-4c1b-9cad-a0d9e5b14d23 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:36.517297 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-8fb8d99b-b369-4ab3-b86e-3a59e87a7044 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:36.525818 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-8fb8d99b-b369-4ab3-b86e-3a59e87a7044 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c" status: 200 len: 1367 microversion: 2.1 time: 0.179019 Aug 09 18:53:36.529736 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 304/586] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:36 2022] GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:36.586341 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-85275c59-32ab-4c1b-9cad-a0d9e5b14d23 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:36.594844 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-85275c59-32ab-4c1b-9cad-a0d9e5b14d23 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1567 microversion: 2.1 time: 0.174958 Aug 09 18:53:36.595408 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 283/587] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:36 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:53:37.351464 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-27927792-bd1b-4725-a279-06db3909ca67 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:37.352064 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-27927792-bd1b-4725-a279-06db3909ca67 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ece2efc3-8ca5-4b96-93cb-42f4065610c6] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:37.358957 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-27927792-bd1b-4725-a279-06db3909ca67 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:37.359426 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-27927792-bd1b-4725-a279-06db3909ca67 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:37.359851 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-27927792-bd1b-4725-a279-06db3909ca67 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:37.360525 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-27927792-bd1b-4725-a279-06db3909ca67 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:37.360967 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-27927792-bd1b-4725-a279-06db3909ca67 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:37.361379 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-27927792-bd1b-4725-a279-06db3909ca67 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:37.487477 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-27927792-bd1b-4725-a279-06db3909ca67 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:37.494781 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-27927792-bd1b-4725-a279-06db3909ca67 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6" status: 200 len: 1363 microversion: 2.1 time: 0.147207 Aug 09 18:53:37.495340 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 305/588] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:37 2022] GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:37.546881 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-85721ebd-748c-4bd6-a2c5-8e3aecf574fd tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:37.547747 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-85721ebd-748c-4bd6-a2c5-8e3aecf574fd tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 98218676-0e95-45b0-877f-4b0f7107048c] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:37.553848 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-85721ebd-748c-4bd6-a2c5-8e3aecf574fd tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:37.554365 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-85721ebd-748c-4bd6-a2c5-8e3aecf574fd tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:37.555055 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-85721ebd-748c-4bd6-a2c5-8e3aecf574fd tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:37.555743 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-85721ebd-748c-4bd6-a2c5-8e3aecf574fd tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:37.556240 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-85721ebd-748c-4bd6-a2c5-8e3aecf574fd tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:37.556714 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-85721ebd-748c-4bd6-a2c5-8e3aecf574fd tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:37.616143 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-9af92f9c-55c7-4538-9b9c-3c41df445850 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:37.616759 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-9af92f9c-55c7-4538-9b9c-3c41df445850 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:37.622670 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9af92f9c-55c7-4538-9b9c-3c41df445850 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:37.623153 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9af92f9c-55c7-4538-9b9c-3c41df445850 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:37.623594 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9af92f9c-55c7-4538-9b9c-3c41df445850 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:37.624288 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9af92f9c-55c7-4538-9b9c-3c41df445850 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:37.624743 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9af92f9c-55c7-4538-9b9c-3c41df445850 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:37.625165 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9af92f9c-55c7-4538-9b9c-3c41df445850 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:37.688166 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-85721ebd-748c-4bd6-a2c5-8e3aecf574fd tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:37.695679 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-85721ebd-748c-4bd6-a2c5-8e3aecf574fd tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c" status: 200 len: 1367 microversion: 2.1 time: 0.152618 Aug 09 18:53:37.696243 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 284/589] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:37 2022] GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:37.757982 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-9af92f9c-55c7-4538-9b9c-3c41df445850 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:37.765915 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-9af92f9c-55c7-4538-9b9c-3c41df445850 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1567 microversion: 2.1 time: 0.154011 Aug 09 18:53:37.766489 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 306/590] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:37 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:53:38.513493 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-537c9f63-c0ad-4bb4-8dc5-84293b67cfad req-1656b5cb-05e6-4489-a888-b0a3f6add605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98218676-0e95-45b0-877f-4b0f7107048c", "name": "network-vif-plugged", "status": "completed", "tag": "0bb8e403-067a-402f-a488-981ea17677b8"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:53:38.517644 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b348870a-11d0-4813-a9f7-4128540a7a5d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:38.517644 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-b348870a-11d0-4813-a9f7-4128540a7a5d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ece2efc3-8ca5-4b96-93cb-42f4065610c6] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:38.520020 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell0:SELECT=2 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:53:38.520725 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell0:SELECT=14 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:53:38.522353 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=2 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:53:38.523295 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=10 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:53:38.526064 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b348870a-11d0-4813-a9f7-4128540a7a5d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:38.526228 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-537c9f63-c0ad-4bb4-8dc5-84293b67cfad req-1656b5cb-05e6-4489-a888-b0a3f6add605 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:38.526680 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-537c9f63-c0ad-4bb4-8dc5-84293b67cfad req-1656b5cb-05e6-4489-a888-b0a3f6add605 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:38.526797 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b348870a-11d0-4813-a9f7-4128540a7a5d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:38.527102 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-537c9f63-c0ad-4bb4-8dc5-84293b67cfad req-1656b5cb-05e6-4489-a888-b0a3f6add605 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:38.527306 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b348870a-11d0-4813-a9f7-4128540a7a5d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:38.528074 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b348870a-11d0-4813-a9f7-4128540a7a5d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:38.528645 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b348870a-11d0-4813-a9f7-4128540a7a5d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:38.529274 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b348870a-11d0-4813-a9f7-4128540a7a5d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:38.541053 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-537c9f63-c0ad-4bb4-8dc5-84293b67cfad req-1656b5cb-05e6-4489-a888-b0a3f6add605 service nova] Creating event network-vif-plugged:0bb8e403-067a-402f-a488-981ea17677b8 for instance 98218676-0e95-45b0-877f-4b0f7107048c on hv-cinder-82660 Aug 09 18:53:38.545773 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-537c9f63-c0ad-4bb4-8dc5-84293b67cfad req-1656b5cb-05e6-4489-a888-b0a3f6add605 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036086 Aug 09 18:53:38.547346 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 285/591] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:53:38.677354 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-b348870a-11d0-4813-a9f7-4128540a7a5d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:38.686478 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-b348870a-11d0-4813-a9f7-4128540a7a5d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6" status: 200 len: 1363 microversion: 2.1 time: 0.174992 Aug 09 18:53:38.687053 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 307/592] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:38 2022] GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:53:38.717791 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-21cf864a-f52a-4bda-b35a-3da9ad89e768 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:38.718497 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-21cf864a-f52a-4bda-b35a-3da9ad89e768 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 98218676-0e95-45b0-877f-4b0f7107048c] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:38.720670 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:53:38.726005 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-21cf864a-f52a-4bda-b35a-3da9ad89e768 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:38.729443 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-21cf864a-f52a-4bda-b35a-3da9ad89e768 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:38.729443 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-21cf864a-f52a-4bda-b35a-3da9ad89e768 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:38.729443 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-21cf864a-f52a-4bda-b35a-3da9ad89e768 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:38.729443 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-21cf864a-f52a-4bda-b35a-3da9ad89e768 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:38.729856 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-21cf864a-f52a-4bda-b35a-3da9ad89e768 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:38.788139 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e7455c99-7c18-47ec-a366-749bbb0f7c9c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:38.788775 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e7455c99-7c18-47ec-a366-749bbb0f7c9c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:38.795611 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e7455c99-7c18-47ec-a366-749bbb0f7c9c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:38.796088 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e7455c99-7c18-47ec-a366-749bbb0f7c9c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:38.796512 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e7455c99-7c18-47ec-a366-749bbb0f7c9c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:38.797199 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e7455c99-7c18-47ec-a366-749bbb0f7c9c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:38.797673 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e7455c99-7c18-47ec-a366-749bbb0f7c9c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:38.798095 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e7455c99-7c18-47ec-a366-749bbb0f7c9c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:38.915283 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-21cf864a-f52a-4bda-b35a-3da9ad89e768 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:38.925425 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-21cf864a-f52a-4bda-b35a-3da9ad89e768 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c" status: 200 len: 1367 microversion: 2.1 time: 0.212732 Aug 09 18:53:38.942714 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 286/593] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:38 2022] GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:38.944423 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e7455c99-7c18-47ec-a366-749bbb0f7c9c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:38.956125 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e7455c99-7c18-47ec-a366-749bbb0f7c9c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1567 microversion: 2.1 time: 0.172300 Aug 09 18:53:38.957268 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 308/594] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:38 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:53:39.707168 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-4bfe4282-92e8-4476-9e55-d1ffcb73df85 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:39.707778 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-4bfe4282-92e8-4476-9e55-d1ffcb73df85 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ece2efc3-8ca5-4b96-93cb-42f4065610c6] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:39.714918 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4bfe4282-92e8-4476-9e55-d1ffcb73df85 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:39.715400 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4bfe4282-92e8-4476-9e55-d1ffcb73df85 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:39.715832 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4bfe4282-92e8-4476-9e55-d1ffcb73df85 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:39.716528 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4bfe4282-92e8-4476-9e55-d1ffcb73df85 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:39.716981 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4bfe4282-92e8-4476-9e55-d1ffcb73df85 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:39.717404 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4bfe4282-92e8-4476-9e55-d1ffcb73df85 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:39.846945 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-4bfe4282-92e8-4476-9e55-d1ffcb73df85 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:39.855024 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-4bfe4282-92e8-4476-9e55-d1ffcb73df85 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6" status: 200 len: 1363 microversion: 2.1 time: 0.152220 Aug 09 18:53:39.855594 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 287/595] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:39 2022] GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:39.947673 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-40cd015d-46a4-4b0b-805b-c472d499363c tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:39.948282 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-40cd015d-46a4-4b0b-805b-c472d499363c tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 98218676-0e95-45b0-877f-4b0f7107048c] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:39.954632 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-40cd015d-46a4-4b0b-805b-c472d499363c tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:39.955109 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-40cd015d-46a4-4b0b-805b-c472d499363c tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:39.955540 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-40cd015d-46a4-4b0b-805b-c472d499363c tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:39.956231 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-40cd015d-46a4-4b0b-805b-c472d499363c tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:39.956687 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-40cd015d-46a4-4b0b-805b-c472d499363c tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:39.957111 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-40cd015d-46a4-4b0b-805b-c472d499363c tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:39.977266 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-0ba22292-8bbf-4d61-a098-e5a14a8a0520 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:39.977855 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-0ba22292-8bbf-4d61-a098-e5a14a8a0520 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:39.984270 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0ba22292-8bbf-4d61-a098-e5a14a8a0520 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:39.984747 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0ba22292-8bbf-4d61-a098-e5a14a8a0520 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:39.985171 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0ba22292-8bbf-4d61-a098-e5a14a8a0520 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:39.985889 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0ba22292-8bbf-4d61-a098-e5a14a8a0520 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:39.986334 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0ba22292-8bbf-4d61-a098-e5a14a8a0520 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:39.986803 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0ba22292-8bbf-4d61-a098-e5a14a8a0520 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:40.092851 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-40cd015d-46a4-4b0b-805b-c472d499363c tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:40.103341 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-40cd015d-46a4-4b0b-805b-c472d499363c tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c" status: 200 len: 1367 microversion: 2.1 time: 0.159385 Aug 09 18:53:40.114231 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 309/596] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:39 2022] GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:40.129268 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-0ba22292-8bbf-4d61-a098-e5a14a8a0520 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:40.137395 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-0ba22292-8bbf-4d61-a098-e5a14a8a0520 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1567 microversion: 2.1 time: 0.164057 Aug 09 18:53:40.138009 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 288/597] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:39 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:40.565410 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-bd2521c1-245e-46bc-8132-5373fdef8006 req-9410d59a-13e5-4d8d-b646-b4efb4bd47c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ece2efc3-8ca5-4b96-93cb-42f4065610c6", "name": "network-vif-plugged", "status": "completed", "tag": "f68a90d2-e740-4361-a743-b3af796112d5"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:53:40.571714 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:53:40.576653 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-bd2521c1-245e-46bc-8132-5373fdef8006 req-9410d59a-13e5-4d8d-b646-b4efb4bd47c9 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:40.577134 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-bd2521c1-245e-46bc-8132-5373fdef8006 req-9410d59a-13e5-4d8d-b646-b4efb4bd47c9 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:40.577593 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-bd2521c1-245e-46bc-8132-5373fdef8006 req-9410d59a-13e5-4d8d-b646-b4efb4bd47c9 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:40.590281 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-bd2521c1-245e-46bc-8132-5373fdef8006 req-9410d59a-13e5-4d8d-b646-b4efb4bd47c9 service nova] Creating event network-vif-plugged:f68a90d2-e740-4361-a743-b3af796112d5 for instance ece2efc3-8ca5-4b96-93cb-42f4065610c6 on hv-cinder-82660 Aug 09 18:53:40.598841 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-bd2521c1-245e-46bc-8132-5373fdef8006 req-9410d59a-13e5-4d8d-b646-b4efb4bd47c9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041377 Aug 09 18:53:40.599452 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 310/598] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:53:40.875514 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-99787fe2-388b-4baa-9ccd-bb42567a3a35 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:40.877002 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-99787fe2-388b-4baa-9ccd-bb42567a3a35 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ece2efc3-8ca5-4b96-93cb-42f4065610c6] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:40.883253 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-99787fe2-388b-4baa-9ccd-bb42567a3a35 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:40.886074 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-99787fe2-388b-4baa-9ccd-bb42567a3a35 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:40.886074 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-99787fe2-388b-4baa-9ccd-bb42567a3a35 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:40.886074 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-99787fe2-388b-4baa-9ccd-bb42567a3a35 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:40.886074 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-99787fe2-388b-4baa-9ccd-bb42567a3a35 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:40.886457 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-99787fe2-388b-4baa-9ccd-bb42567a3a35 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:41.081759 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-99787fe2-388b-4baa-9ccd-bb42567a3a35 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:41.089828 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-99787fe2-388b-4baa-9ccd-bb42567a3a35 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6" status: 200 len: 1363 microversion: 2.1 time: 0.218176 Aug 09 18:53:41.090406 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 289/599] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:40 2022] GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6 => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:41.125223 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-526c00c1-c78e-4d4d-9400-2fc903cd1660 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:41.126097 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-526c00c1-c78e-4d4d-9400-2fc903cd1660 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 98218676-0e95-45b0-877f-4b0f7107048c] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:41.132714 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-526c00c1-c78e-4d4d-9400-2fc903cd1660 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:41.133196 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-526c00c1-c78e-4d4d-9400-2fc903cd1660 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:41.133662 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-526c00c1-c78e-4d4d-9400-2fc903cd1660 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:41.134358 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-526c00c1-c78e-4d4d-9400-2fc903cd1660 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:41.134807 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-526c00c1-c78e-4d4d-9400-2fc903cd1660 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:41.135237 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-526c00c1-c78e-4d4d-9400-2fc903cd1660 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:41.159287 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-467128b4-1b80-45bb-8481-275d37d5dbc3 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:41.159895 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-467128b4-1b80-45bb-8481-275d37d5dbc3 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:41.166415 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-467128b4-1b80-45bb-8481-275d37d5dbc3 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:41.166893 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-467128b4-1b80-45bb-8481-275d37d5dbc3 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:41.167322 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-467128b4-1b80-45bb-8481-275d37d5dbc3 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:41.168007 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-467128b4-1b80-45bb-8481-275d37d5dbc3 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:41.168451 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-467128b4-1b80-45bb-8481-275d37d5dbc3 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:41.168867 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-467128b4-1b80-45bb-8481-275d37d5dbc3 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:41.273660 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-526c00c1-c78e-4d4d-9400-2fc903cd1660 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:41.281657 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-526c00c1-c78e-4d4d-9400-2fc903cd1660 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c" status: 200 len: 1557 microversion: 2.1 time: 0.161175 Aug 09 18:53:41.282236 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 311/600] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:41 2022] GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c => generated 1557 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:41.302129 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-ab502152-38f0-4f4b-80b4-beb8f39e14dc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:41.302616 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-ab502152-38f0-4f4b-80b4-beb8f39e14dc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 98218676-0e95-45b0-877f-4b0f7107048c] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:41.308872 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ab502152-38f0-4f4b-80b4-beb8f39e14dc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:41.309367 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ab502152-38f0-4f4b-80b4-beb8f39e14dc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:41.309804 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ab502152-38f0-4f4b-80b4-beb8f39e14dc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:41.310488 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ab502152-38f0-4f4b-80b4-beb8f39e14dc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:41.310936 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ab502152-38f0-4f4b-80b4-beb8f39e14dc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:41.311353 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ab502152-38f0-4f4b-80b4-beb8f39e14dc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:41.316203 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-467128b4-1b80-45bb-8481-275d37d5dbc3 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:41.323788 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-467128b4-1b80-45bb-8481-275d37d5dbc3 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1567 microversion: 2.1 time: 0.168571 Aug 09 18:53:41.324444 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 290/601] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:41 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:53:41.391179 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-ab502152-38f0-4f4b-80b4-beb8f39e14dc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092848 Aug 09 18:53:41.391773 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 312/602] 10.222.0.57 () {58 vars in 1275 bytes} [Tue Aug 9 18:53:41 2022] GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:53:42.109857 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-e1eb8f05-f0e0-4bfa-8147-0dc0b02552ff tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:42.110473 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-e1eb8f05-f0e0-4bfa-8147-0dc0b02552ff tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ece2efc3-8ca5-4b96-93cb-42f4065610c6] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:42.117498 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e1eb8f05-f0e0-4bfa-8147-0dc0b02552ff tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:42.118156 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e1eb8f05-f0e0-4bfa-8147-0dc0b02552ff tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:42.118659 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e1eb8f05-f0e0-4bfa-8147-0dc0b02552ff tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:42.119940 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e1eb8f05-f0e0-4bfa-8147-0dc0b02552ff tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:42.120399 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e1eb8f05-f0e0-4bfa-8147-0dc0b02552ff tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:42.120823 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e1eb8f05-f0e0-4bfa-8147-0dc0b02552ff tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:42.253074 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-e1eb8f05-f0e0-4bfa-8147-0dc0b02552ff tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:42.261198 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-e1eb8f05-f0e0-4bfa-8147-0dc0b02552ff tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6" status: 200 len: 1363 microversion: 2.1 time: 0.155374 Aug 09 18:53:42.272871 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 291/603] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:42 2022] GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:42.346277 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-3a7c2c6c-961f-4048-ade1-ec92292d6c7f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:42.347036 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-3a7c2c6c-961f-4048-ade1-ec92292d6c7f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:42.353133 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3a7c2c6c-961f-4048-ade1-ec92292d6c7f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:42.354142 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3a7c2c6c-961f-4048-ade1-ec92292d6c7f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:42.354584 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3a7c2c6c-961f-4048-ade1-ec92292d6c7f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:42.355286 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3a7c2c6c-961f-4048-ade1-ec92292d6c7f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:42.355740 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3a7c2c6c-961f-4048-ade1-ec92292d6c7f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:42.356161 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3a7c2c6c-961f-4048-ade1-ec92292d6c7f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:42.456022 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-ff744d81-a0d6-466b-ba09-bbf2173f085d req-d941cf66-bb21-4dd0-b578-df36d2cc9beb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98218676-0e95-45b0-877f-4b0f7107048c", "tag": "0bb8e403-067a-402f-a488-981ea17677b8"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:53:42.465749 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-ff744d81-a0d6-466b-ba09-bbf2173f085d req-d941cf66-bb21-4dd0-b578-df36d2cc9beb service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:42.465981 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-ff744d81-a0d6-466b-ba09-bbf2173f085d req-d941cf66-bb21-4dd0-b578-df36d2cc9beb service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:42.466389 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-ff744d81-a0d6-466b-ba09-bbf2173f085d req-d941cf66-bb21-4dd0-b578-df36d2cc9beb service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:42.477506 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-ff744d81-a0d6-466b-ba09-bbf2173f085d req-d941cf66-bb21-4dd0-b578-df36d2cc9beb service nova] Creating event network-changed:0bb8e403-067a-402f-a488-981ea17677b8 for instance 98218676-0e95-45b0-877f-4b0f7107048c on hv-cinder-82660 Aug 09 18:53:42.483344 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-ff744d81-a0d6-466b-ba09-bbf2173f085d req-d941cf66-bb21-4dd0-b578-df36d2cc9beb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031351 Aug 09 18:53:42.483956 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 292/604] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:53:42.520179 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-3a7c2c6c-961f-4048-ade1-ec92292d6c7f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:42.528210 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-3a7c2c6c-961f-4048-ade1-ec92292d6c7f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1567 microversion: 2.1 time: 0.186356 Aug 09 18:53:42.528789 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 313/605] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:42 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:43.283016 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-5d24adaa-b28d-47af-bb43-98ab808d1f7d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:43.283718 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-5d24adaa-b28d-47af-bb43-98ab808d1f7d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ece2efc3-8ca5-4b96-93cb-42f4065610c6] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:43.289979 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5d24adaa-b28d-47af-bb43-98ab808d1f7d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:43.290477 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5d24adaa-b28d-47af-bb43-98ab808d1f7d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:43.290944 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5d24adaa-b28d-47af-bb43-98ab808d1f7d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:43.291657 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5d24adaa-b28d-47af-bb43-98ab808d1f7d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:43.292115 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5d24adaa-b28d-47af-bb43-98ab808d1f7d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:43.292543 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5d24adaa-b28d-47af-bb43-98ab808d1f7d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:43.495740 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-5d24adaa-b28d-47af-bb43-98ab808d1f7d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:43.503957 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-5d24adaa-b28d-47af-bb43-98ab808d1f7d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6" status: 200 len: 1549 microversion: 2.1 time: 0.224958 Aug 09 18:53:43.504602 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 293/606] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:43 2022] GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6 => generated 1549 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:43.525030 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b87eb3d1-93a0-4da8-b297-d3534a0fb91f tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:43.526137 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-b87eb3d1-93a0-4da8-b297-d3534a0fb91f tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ece2efc3-8ca5-4b96-93cb-42f4065610c6] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:43.532699 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b87eb3d1-93a0-4da8-b297-d3534a0fb91f tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:43.533190 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b87eb3d1-93a0-4da8-b297-d3534a0fb91f tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:43.533681 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b87eb3d1-93a0-4da8-b297-d3534a0fb91f tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:43.534395 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b87eb3d1-93a0-4da8-b297-d3534a0fb91f tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:43.534851 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b87eb3d1-93a0-4da8-b297-d3534a0fb91f tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:43.535275 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b87eb3d1-93a0-4da8-b297-d3534a0fb91f tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:43.550354 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-8cf69d31-de4d-46d2-81da-a07e8c30af6e tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:43.550993 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-8cf69d31-de4d-46d2-81da-a07e8c30af6e tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:43.554416 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=100 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:53:43.558007 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-8cf69d31-de4d-46d2-81da-a07e8c30af6e tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:43.560890 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-8cf69d31-de4d-46d2-81da-a07e8c30af6e tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:43.560890 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-8cf69d31-de4d-46d2-81da-a07e8c30af6e tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:43.560890 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-8cf69d31-de4d-46d2-81da-a07e8c30af6e tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:43.560890 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-8cf69d31-de4d-46d2-81da-a07e8c30af6e tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:43.561358 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-8cf69d31-de4d-46d2-81da-a07e8c30af6e tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:43.618280 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-b87eb3d1-93a0-4da8-b297-d3534a0fb91f tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097357 Aug 09 18:53:43.618930 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 314/607] 10.222.0.57 () {58 vars in 1275 bytes} [Tue Aug 9 18:53:43 2022] GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:53:43.819912 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-8cf69d31-de4d-46d2-81da-a07e8c30af6e tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:43.827940 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-8cf69d31-de4d-46d2-81da-a07e8c30af6e tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1567 microversion: 2.1 time: 0.281655 Aug 09 18:53:43.828553 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 294/608] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:43 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1567 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:44.849919 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-cb7b6993-5108-4969-a64e-da50406df571 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:44.850536 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-cb7b6993-5108-4969-a64e-da50406df571 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:44.858320 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cb7b6993-5108-4969-a64e-da50406df571 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:44.858999 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cb7b6993-5108-4969-a64e-da50406df571 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:44.859721 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cb7b6993-5108-4969-a64e-da50406df571 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:44.860588 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cb7b6993-5108-4969-a64e-da50406df571 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:44.861245 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cb7b6993-5108-4969-a64e-da50406df571 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:44.861855 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cb7b6993-5108-4969-a64e-da50406df571 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:44.892123 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-e1e95899-0c65-4d83-a62d-2308dcc8701b req-b04b06f6-0b8c-4e0a-a26f-0caaee1f7b91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ece2efc3-8ca5-4b96-93cb-42f4065610c6", "tag": "f68a90d2-e740-4361-a743-b3af796112d5"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:53:44.902965 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-e1e95899-0c65-4d83-a62d-2308dcc8701b req-b04b06f6-0b8c-4e0a-a26f-0caaee1f7b91 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:44.903448 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-e1e95899-0c65-4d83-a62d-2308dcc8701b req-b04b06f6-0b8c-4e0a-a26f-0caaee1f7b91 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:44.904042 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-e1e95899-0c65-4d83-a62d-2308dcc8701b req-b04b06f6-0b8c-4e0a-a26f-0caaee1f7b91 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:44.921254 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-e1e95899-0c65-4d83-a62d-2308dcc8701b req-b04b06f6-0b8c-4e0a-a26f-0caaee1f7b91 service nova] Creating event network-changed:f68a90d2-e740-4361-a743-b3af796112d5 for instance ece2efc3-8ca5-4b96-93cb-42f4065610c6 on hv-cinder-82660 Aug 09 18:53:44.927812 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-e1e95899-0c65-4d83-a62d-2308dcc8701b req-b04b06f6-0b8c-4e0a-a26f-0caaee1f7b91 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039001 Aug 09 18:53:44.928696 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 295/609] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:53:45.017244 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-cb7b6993-5108-4969-a64e-da50406df571 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:45.025813 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-cb7b6993-5108-4969-a64e-da50406df571 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1567 microversion: 2.1 time: 0.179620 Aug 09 18:53:45.027042 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 315/610] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:44 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:46.049565 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-17dfcf88-be3b-4a47-ad4b-85caa2ff6cb5 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:46.050264 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-17dfcf88-be3b-4a47-ad4b-85caa2ff6cb5 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:46.058444 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-17dfcf88-be3b-4a47-ad4b-85caa2ff6cb5 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:46.061541 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-17dfcf88-be3b-4a47-ad4b-85caa2ff6cb5 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:46.061541 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-17dfcf88-be3b-4a47-ad4b-85caa2ff6cb5 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:46.061541 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-17dfcf88-be3b-4a47-ad4b-85caa2ff6cb5 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:46.061541 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-17dfcf88-be3b-4a47-ad4b-85caa2ff6cb5 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:46.062062 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-17dfcf88-be3b-4a47-ad4b-85caa2ff6cb5 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:46.350183 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-17dfcf88-be3b-4a47-ad4b-85caa2ff6cb5 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:46.358183 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-17dfcf88-be3b-4a47-ad4b-85caa2ff6cb5 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1567 microversion: 2.1 time: 0.314477 Aug 09 18:53:46.358747 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 296/611] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:46 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1567 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:47.378958 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-46f1bd7d-b048-4a9b-a9b9-aa1eb3619b3d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:47.379582 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-46f1bd7d-b048-4a9b-a9b9-aa1eb3619b3d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:47.386526 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-46f1bd7d-b048-4a9b-a9b9-aa1eb3619b3d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:47.387015 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-46f1bd7d-b048-4a9b-a9b9-aa1eb3619b3d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:47.387449 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-46f1bd7d-b048-4a9b-a9b9-aa1eb3619b3d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:47.388142 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-46f1bd7d-b048-4a9b-a9b9-aa1eb3619b3d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:47.388600 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-46f1bd7d-b048-4a9b-a9b9-aa1eb3619b3d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:47.389021 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-46f1bd7d-b048-4a9b-a9b9-aa1eb3619b3d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:47.517623 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-46f1bd7d-b048-4a9b-a9b9-aa1eb3619b3d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:47.525151 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-46f1bd7d-b048-4a9b-a9b9-aa1eb3619b3d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1567 microversion: 2.1 time: 0.149990 Aug 09 18:53:47.525763 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 316/612] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:47 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:48.545130 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-19ebd4d8-d82d-4a61-a3ec-8ccd55e5e646 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:48.545707 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-19ebd4d8-d82d-4a61-a3ec-8ccd55e5e646 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:48.552209 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-19ebd4d8-d82d-4a61-a3ec-8ccd55e5e646 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:48.552689 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-19ebd4d8-d82d-4a61-a3ec-8ccd55e5e646 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:48.553123 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-19ebd4d8-d82d-4a61-a3ec-8ccd55e5e646 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:48.553844 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-19ebd4d8-d82d-4a61-a3ec-8ccd55e5e646 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:48.554302 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-19ebd4d8-d82d-4a61-a3ec-8ccd55e5e646 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:48.554728 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-19ebd4d8-d82d-4a61-a3ec-8ccd55e5e646 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:48.697192 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-19ebd4d8-d82d-4a61-a3ec-8ccd55e5e646 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:48.705359 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-19ebd4d8-d82d-4a61-a3ec-8ccd55e5e646 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1567 microversion: 2.1 time: 0.164200 Aug 09 18:53:48.705948 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 297/613] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:48 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:49.726277 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-eb402512-70a6-43bd-b967-586de47c0f0e tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:49.726890 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-eb402512-70a6-43bd-b967-586de47c0f0e tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:49.733375 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-eb402512-70a6-43bd-b967-586de47c0f0e tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:49.733953 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-eb402512-70a6-43bd-b967-586de47c0f0e tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:49.734392 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-eb402512-70a6-43bd-b967-586de47c0f0e tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:49.735086 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-eb402512-70a6-43bd-b967-586de47c0f0e tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:49.735540 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-eb402512-70a6-43bd-b967-586de47c0f0e tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:49.735962 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-eb402512-70a6-43bd-b967-586de47c0f0e tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:49.923774 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-eb402512-70a6-43bd-b967-586de47c0f0e tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:49.931637 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-eb402512-70a6-43bd-b967-586de47c0f0e tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1567 microversion: 2.1 time: 0.209351 Aug 09 18:53:49.932223 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 317/614] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:49 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1567 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:50.954058 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-35d516ee-b112-4f3b-8c65-25eb25f1f46f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:50.954664 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-35d516ee-b112-4f3b-8c65-25eb25f1f46f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:50.961205 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-35d516ee-b112-4f3b-8c65-25eb25f1f46f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:50.961724 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-35d516ee-b112-4f3b-8c65-25eb25f1f46f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:50.962157 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-35d516ee-b112-4f3b-8c65-25eb25f1f46f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:50.962846 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-35d516ee-b112-4f3b-8c65-25eb25f1f46f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:50.963475 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-35d516ee-b112-4f3b-8c65-25eb25f1f46f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:50.963704 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-35d516ee-b112-4f3b-8c65-25eb25f1f46f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:51.103801 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-35d516ee-b112-4f3b-8c65-25eb25f1f46f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:51.113034 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-35d516ee-b112-4f3b-8c65-25eb25f1f46f tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1508 microversion: 2.1 time: 0.162838 Aug 09 18:53:51.113641 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 298/615] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:50 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:51.133923 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a5cdc6f6-3761-4e31-b13e-dd91d84db170 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:53:51.134552 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-a5cdc6f6-3761-4e31-b13e-dd91d84db170 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:51.141397 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a5cdc6f6-3761-4e31-b13e-dd91d84db170 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:51.141922 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a5cdc6f6-3761-4e31-b13e-dd91d84db170 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:51.142359 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a5cdc6f6-3761-4e31-b13e-dd91d84db170 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:51.143090 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a5cdc6f6-3761-4e31-b13e-dd91d84db170 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:51.143542 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a5cdc6f6-3761-4e31-b13e-dd91d84db170 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:51.143973 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a5cdc6f6-3761-4e31-b13e-dd91d84db170 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:51.175907 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-a5cdc6f6-3761-4e31-b13e-dd91d84db170 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124725) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 09 18:53:51.434725 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-772d4465-27b9-46c0-a8ba-d84c26d2651f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:51.435211 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-772d4465-27b9-46c0-a8ba-d84c26d2651f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:51.441239 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-772d4465-27b9-46c0-a8ba-d84c26d2651f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:51.441759 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-772d4465-27b9-46c0-a8ba-d84c26d2651f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:51.442192 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-772d4465-27b9-46c0-a8ba-d84c26d2651f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:51.442879 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-772d4465-27b9-46c0-a8ba-d84c26d2651f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:51.443324 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-772d4465-27b9-46c0-a8ba-d84c26d2651f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:51.443738 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-772d4465-27b9-46c0-a8ba-d84c26d2651f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:51.493257 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-a5cdc6f6-3761-4e31-b13e-dd91d84db170 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "POST /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7/action" status: 202 len: 0 microversion: 2.1 time: 0.363230 Aug 09 18:53:51.493894 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 318/616] 10.222.0.57 () {60 vars in 1278 bytes} [Tue Aug 9 18:53:51 2022] POST /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7/action => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:53:51.502145 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f148b849-72bf-4a01-877c-8ee6a52908a0 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:51.505957 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-f148b849-72bf-4a01-877c-8ee6a52908a0 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:51.509424 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f148b849-72bf-4a01-877c-8ee6a52908a0 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:51.510055 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f148b849-72bf-4a01-877c-8ee6a52908a0 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:51.511296 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f148b849-72bf-4a01-877c-8ee6a52908a0 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:51.512066 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f148b849-72bf-4a01-877c-8ee6a52908a0 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:51.512521 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f148b849-72bf-4a01-877c-8ee6a52908a0 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:51.513306 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f148b849-72bf-4a01-877c-8ee6a52908a0 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:51.540628 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:53:51.542413 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.objects.instance [None req-772d4465-27b9-46c0-a8ba-d84c26d2651f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lazy-loading 'services' on Instance uuid e15bc2b4-4702-4ee5-9483-87db30954da2 {{(pid=124726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:53:51.689560 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f148b849-72bf-4a01-877c-8ee6a52908a0 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:51.697721 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f148b849-72bf-4a01-877c-8ee6a52908a0 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1516 microversion: 2.1 time: 0.199226 Aug 09 18:53:51.698391 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 319/617] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:51 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1516 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:53:51.766836 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-772d4465-27b9-46c0-a8ba-d84c26d2651f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "DELETE /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2/os-volume_attachments/33655ffe-0c8d-447b-bf46-cc9509cd41ba" status: 202 len: 0 microversion: 2.1 time: 0.336165 Aug 09 18:53:51.767452 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 299/618] 10.222.0.57 () {58 vars in 1416 bytes} [Tue Aug 9 18:53:51 2022] DELETE /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2/os-volume_attachments/33655ffe-0c8d-447b-bf46-cc9509cd41ba => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:53:51.777087 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f36f7d04-b04c-49eb-b349-835e4aa76c3b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:51.779871 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-f36f7d04-b04c-49eb-b349-835e4aa76c3b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:51.786521 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f36f7d04-b04c-49eb-b349-835e4aa76c3b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:51.787442 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f36f7d04-b04c-49eb-b349-835e4aa76c3b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:51.787442 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f36f7d04-b04c-49eb-b349-835e4aa76c3b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:51.788157 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f36f7d04-b04c-49eb-b349-835e4aa76c3b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:51.788627 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f36f7d04-b04c-49eb-b349-835e4aa76c3b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:51.789020 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f36f7d04-b04c-49eb-b349-835e4aa76c3b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:51.822881 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f36f7d04-b04c-49eb-b349-835e4aa76c3b tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050864 Aug 09 18:53:51.823463 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 320/619] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 9 18:53:51 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:53:52.391320 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-b9f5d6fc-8274-4681-bc33-fcadca85283f req-71affee5-8e95-41d1-aaa0-19006d8251ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7", "name": "network-vif-unplugged", "status": "completed", "tag": "f4782f09-a0b0-4715-98fa-ea0d74933d8d"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:53:52.402068 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-b9f5d6fc-8274-4681-bc33-fcadca85283f req-71affee5-8e95-41d1-aaa0-19006d8251ca service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:52.402549 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-b9f5d6fc-8274-4681-bc33-fcadca85283f req-71affee5-8e95-41d1-aaa0-19006d8251ca service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:52.402978 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-b9f5d6fc-8274-4681-bc33-fcadca85283f req-71affee5-8e95-41d1-aaa0-19006d8251ca service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:52.414430 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.compute.server_external_events [req-b9f5d6fc-8274-4681-bc33-fcadca85283f req-71affee5-8e95-41d1-aaa0-19006d8251ca service nova] Unable to find a host for instance fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7. Dropping event network-vif-unplugged {{(pid=124726) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 09 18:53:52.415388 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-b9f5d6fc-8274-4681-bc33-fcadca85283f req-71affee5-8e95-41d1-aaa0-19006d8251ca service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029886 Aug 09 18:53:52.416025 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 300/620] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 09 18:53:52.719243 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5cd33936-258d-48d0-aa52-76ea4226f64d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:52.719853 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-5cd33936-258d-48d0-aa52-76ea4226f64d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:52.726408 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5cd33936-258d-48d0-aa52-76ea4226f64d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:52.726890 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5cd33936-258d-48d0-aa52-76ea4226f64d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:52.727327 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5cd33936-258d-48d0-aa52-76ea4226f64d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:52.728028 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5cd33936-258d-48d0-aa52-76ea4226f64d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:52.728489 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5cd33936-258d-48d0-aa52-76ea4226f64d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:52.728916 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5cd33936-258d-48d0-aa52-76ea4226f64d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:52.835486 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-77a7f6e4-3d4c-4d8e-9891-ad06131fe229 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:52.837948 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-77a7f6e4-3d4c-4d8e-9891-ad06131fe229 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:52.845218 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-77a7f6e4-3d4c-4d8e-9891-ad06131fe229 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:52.845750 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-77a7f6e4-3d4c-4d8e-9891-ad06131fe229 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:52.846184 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-77a7f6e4-3d4c-4d8e-9891-ad06131fe229 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:52.847091 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-77a7f6e4-3d4c-4d8e-9891-ad06131fe229 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:52.847546 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-77a7f6e4-3d4c-4d8e-9891-ad06131fe229 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:52.847973 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-77a7f6e4-3d4c-4d8e-9891-ad06131fe229 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:52.875681 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5cd33936-258d-48d0-aa52-76ea4226f64d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:52.878792 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-77a7f6e4-3d4c-4d8e-9891-ad06131fe229 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047502 Aug 09 18:53:52.879381 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 301/621] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 9 18:53:52 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:53:52.884167 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-5cd33936-258d-48d0-aa52-76ea4226f64d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1516 microversion: 2.1 time: 0.168777 Aug 09 18:53:52.884755 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 321/622] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:52 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1516 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:53:53.892353 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-29fe33f1-3676-4e9f-ba0d-08ef0db68a0f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:53.895019 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-29fe33f1-3676-4e9f-ba0d-08ef0db68a0f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:53.903871 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-29fe33f1-3676-4e9f-ba0d-08ef0db68a0f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:53.904368 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-29fe33f1-3676-4e9f-ba0d-08ef0db68a0f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:53.904816 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-29fe33f1-3676-4e9f-ba0d-08ef0db68a0f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:53.905537 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-29fe33f1-3676-4e9f-ba0d-08ef0db68a0f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:53.906011 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-29fe33f1-3676-4e9f-ba0d-08ef0db68a0f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:53.906492 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-fb0163d8-384b-4518-bc9e-df3ffac83038 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:53.907066 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-29fe33f1-3676-4e9f-ba0d-08ef0db68a0f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:53.907243 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-fb0163d8-384b-4518-bc9e-df3ffac83038 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:53.913989 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fb0163d8-384b-4518-bc9e-df3ffac83038 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:53.936358 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fb0163d8-384b-4518-bc9e-df3ffac83038 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:53.936358 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fb0163d8-384b-4518-bc9e-df3ffac83038 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:53.936358 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fb0163d8-384b-4518-bc9e-df3ffac83038 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:53.936358 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fb0163d8-384b-4518-bc9e-df3ffac83038 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:53.936765 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fb0163d8-384b-4518-bc9e-df3ffac83038 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:53.937127 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-29fe33f1-3676-4e9f-ba0d-08ef0db68a0f tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049364 Aug 09 18:53:53.937726 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 302/623] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 9 18:53:53 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 18:53:54.025619 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-18b4a755-b13a-4eba-b9f6-9d8202fdb133 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:54.026135 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-18b4a755-b13a-4eba-b9f6-9d8202fdb133 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:54.032198 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-18b4a755-b13a-4eba-b9f6-9d8202fdb133 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:54.032759 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-18b4a755-b13a-4eba-b9f6-9d8202fdb133 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:54.033259 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-18b4a755-b13a-4eba-b9f6-9d8202fdb133 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:54.034051 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-18b4a755-b13a-4eba-b9f6-9d8202fdb133 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:54.035016 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-18b4a755-b13a-4eba-b9f6-9d8202fdb133 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:54.035016 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-18b4a755-b13a-4eba-b9f6-9d8202fdb133 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:54.059878 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-fb0163d8-384b-4518-bc9e-df3ffac83038 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:54.062378 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-18b4a755-b13a-4eba-b9f6-9d8202fdb133 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Going to try to terminate instance {{(pid=124726) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:53:54.067502 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-fb0163d8-384b-4518-bc9e-df3ffac83038 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1518 microversion: 2.1 time: 0.165328 Aug 09 18:53:54.070183 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 322/624] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:53 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:53:54.344662 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-18b4a755-b13a-4eba-b9f6-9d8202fdb133 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "DELETE /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2" status: 204 len: 0 microversion: 2.1 time: 0.322691 Aug 09 18:53:54.345254 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 303/625] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 9 18:53:54 2022] DELETE /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 18:53:54.353126 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-50a435c9-8c0c-4b94-914a-b41395236474 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:54.353765 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-50a435c9-8c0c-4b94-914a-b41395236474 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:54.359652 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-50a435c9-8c0c-4b94-914a-b41395236474 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:54.360125 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-50a435c9-8c0c-4b94-914a-b41395236474 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:54.360740 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-50a435c9-8c0c-4b94-914a-b41395236474 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:54.361228 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-50a435c9-8c0c-4b94-914a-b41395236474 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:54.361709 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-50a435c9-8c0c-4b94-914a-b41395236474 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:54.362124 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-50a435c9-8c0c-4b94-914a-b41395236474 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:54.488525 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-50a435c9-8c0c-4b94-914a-b41395236474 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:54.495943 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-50a435c9-8c0c-4b94-914a-b41395236474 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2" status: 200 len: 1690 microversion: 2.1 time: 0.146599 Aug 09 18:53:54.496558 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 323/626] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:54 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2 => generated 1690 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:55.090280 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-d213c339-4571-4e57-937f-26d04e152006 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:55.090980 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-d213c339-4571-4e57-937f-26d04e152006 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:55.097584 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d213c339-4571-4e57-937f-26d04e152006 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:55.098070 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d213c339-4571-4e57-937f-26d04e152006 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:55.098525 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d213c339-4571-4e57-937f-26d04e152006 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:55.099186 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d213c339-4571-4e57-937f-26d04e152006 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:55.099633 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d213c339-4571-4e57-937f-26d04e152006 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:55.100120 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d213c339-4571-4e57-937f-26d04e152006 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:55.239308 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-d213c339-4571-4e57-937f-26d04e152006 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:55.247640 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-d213c339-4571-4e57-937f-26d04e152006 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1574 microversion: 2.1 time: 0.161690 Aug 09 18:53:55.248229 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 304/627] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:55 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:55.516168 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-93ca27b0-570c-411f-a8fd-43ea048b7cc7 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:55.516767 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-93ca27b0-570c-411f-a8fd-43ea048b7cc7 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:55.523198 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-93ca27b0-570c-411f-a8fd-43ea048b7cc7 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:55.523663 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-93ca27b0-570c-411f-a8fd-43ea048b7cc7 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:55.524087 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-93ca27b0-570c-411f-a8fd-43ea048b7cc7 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:55.524760 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-93ca27b0-570c-411f-a8fd-43ea048b7cc7 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:55.525204 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-93ca27b0-570c-411f-a8fd-43ea048b7cc7 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:55.525642 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-93ca27b0-570c-411f-a8fd-43ea048b7cc7 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:55.666534 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-93ca27b0-570c-411f-a8fd-43ea048b7cc7 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:55.675057 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-93ca27b0-570c-411f-a8fd-43ea048b7cc7 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2" status: 200 len: 1690 microversion: 2.1 time: 0.162698 Aug 09 18:53:55.675618 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 324/628] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:55 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2 => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:56.267975 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-adffae18-bf11-46d4-a73c-412368a60069 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:56.268578 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-adffae18-bf11-46d4-a73c-412368a60069 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:56.275073 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-adffae18-bf11-46d4-a73c-412368a60069 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:56.275591 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-adffae18-bf11-46d4-a73c-412368a60069 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:56.276018 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-adffae18-bf11-46d4-a73c-412368a60069 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:56.277202 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-adffae18-bf11-46d4-a73c-412368a60069 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:56.277700 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-adffae18-bf11-46d4-a73c-412368a60069 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:56.278120 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-adffae18-bf11-46d4-a73c-412368a60069 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:56.411887 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-adffae18-bf11-46d4-a73c-412368a60069 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:56.420156 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-adffae18-bf11-46d4-a73c-412368a60069 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1574 microversion: 2.1 time: 0.156091 Aug 09 18:53:56.420737 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 305/629] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:56 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:56.695994 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d978c3ce-5506-43b3-81f4-2f67bf5abdc4 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:56.696540 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-d978c3ce-5506-43b3-81f4-2f67bf5abdc4 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:56.703484 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d978c3ce-5506-43b3-81f4-2f67bf5abdc4 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:56.703958 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d978c3ce-5506-43b3-81f4-2f67bf5abdc4 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:56.704387 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d978c3ce-5506-43b3-81f4-2f67bf5abdc4 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:56.705070 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d978c3ce-5506-43b3-81f4-2f67bf5abdc4 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:56.705513 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d978c3ce-5506-43b3-81f4-2f67bf5abdc4 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:56.705960 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d978c3ce-5506-43b3-81f4-2f67bf5abdc4 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:56.837483 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d978c3ce-5506-43b3-81f4-2f67bf5abdc4 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:56.845566 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-d978c3ce-5506-43b3-81f4-2f67bf5abdc4 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2" status: 200 len: 1690 microversion: 2.1 time: 0.153525 Aug 09 18:53:56.846144 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 325/630] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:56 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2 => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:57.440672 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-e0048534-c2e6-4413-9755-3d779c7f12c6 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:57.441256 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-e0048534-c2e6-4413-9755-3d779c7f12c6 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:57.447678 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e0048534-c2e6-4413-9755-3d779c7f12c6 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:57.448664 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e0048534-c2e6-4413-9755-3d779c7f12c6 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:57.449091 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e0048534-c2e6-4413-9755-3d779c7f12c6 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:57.449799 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e0048534-c2e6-4413-9755-3d779c7f12c6 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:57.450249 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e0048534-c2e6-4413-9755-3d779c7f12c6 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:57.450669 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e0048534-c2e6-4413-9755-3d779c7f12c6 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:57.578703 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-e0048534-c2e6-4413-9755-3d779c7f12c6 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:57.586130 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-e0048534-c2e6-4413-9755-3d779c7f12c6 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1574 microversion: 2.1 time: 0.149334 Aug 09 18:53:57.590441 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 306/631] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:57 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:57.867185 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-9cc0f44c-a84d-46c9-8638-d78038df83b3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:57.867795 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-9cc0f44c-a84d-46c9-8638-d78038df83b3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:57.874316 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9cc0f44c-a84d-46c9-8638-d78038df83b3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:57.874800 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9cc0f44c-a84d-46c9-8638-d78038df83b3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:57.875235 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9cc0f44c-a84d-46c9-8638-d78038df83b3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:57.875934 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9cc0f44c-a84d-46c9-8638-d78038df83b3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:57.876385 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9cc0f44c-a84d-46c9-8638-d78038df83b3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:57.876809 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9cc0f44c-a84d-46c9-8638-d78038df83b3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:58.013727 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-9cc0f44c-a84d-46c9-8638-d78038df83b3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:58.022447 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-9cc0f44c-a84d-46c9-8638-d78038df83b3 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2" status: 200 len: 1690 microversion: 2.1 time: 0.159030 Aug 09 18:53:58.023038 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 326/632] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:57 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2 => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:53:58.610937 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-bab0b593-d769-466d-8458-f74b5047b005 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:58.611552 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-bab0b593-d769-466d-8458-f74b5047b005 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:58.619207 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-bab0b593-d769-466d-8458-f74b5047b005 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:58.623336 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-bab0b593-d769-466d-8458-f74b5047b005 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:58.623336 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-bab0b593-d769-466d-8458-f74b5047b005 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:58.623336 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-bab0b593-d769-466d-8458-f74b5047b005 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:58.623336 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-bab0b593-d769-466d-8458-f74b5047b005 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:58.623712 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-bab0b593-d769-466d-8458-f74b5047b005 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:58.860313 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-bab0b593-d769-466d-8458-f74b5047b005 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:58.868072 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-bab0b593-d769-466d-8458-f74b5047b005 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1574 microversion: 2.1 time: 0.261348 Aug 09 18:53:58.882147 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 307/633] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:58 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1574 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:59.044187 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-4072839f-0b4c-4f2e-a483-9dc50076a67d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:59.044829 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-4072839f-0b4c-4f2e-a483-9dc50076a67d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:59.051399 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4072839f-0b4c-4f2e-a483-9dc50076a67d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:59.051887 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4072839f-0b4c-4f2e-a483-9dc50076a67d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:59.052327 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4072839f-0b4c-4f2e-a483-9dc50076a67d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:59.053025 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4072839f-0b4c-4f2e-a483-9dc50076a67d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:59.053480 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4072839f-0b4c-4f2e-a483-9dc50076a67d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:59.053939 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4072839f-0b4c-4f2e-a483-9dc50076a67d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:59.189086 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-4072839f-0b4c-4f2e-a483-9dc50076a67d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:53:59.196697 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-4072839f-0b4c-4f2e-a483-9dc50076a67d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2" status: 200 len: 1690 microversion: 2.1 time: 0.156456 Aug 09 18:53:59.197494 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 327/634] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:59 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2 => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:53:59.684912 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-98cf48ee-e04e-4af4-bfc0-c1895cf177c4 req-4f972091-0a44-471a-86d6-599169d487a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e15bc2b4-4702-4ee5-9483-87db30954da2", "name": "network-vif-deleted", "tag": "6d0d654f-2f8f-4f17-bf93-aa249db5c6d8"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:53:59.694953 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-98cf48ee-e04e-4af4-bfc0-c1895cf177c4 req-4f972091-0a44-471a-86d6-599169d487a7 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:59.695439 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-98cf48ee-e04e-4af4-bfc0-c1895cf177c4 req-4f972091-0a44-471a-86d6-599169d487a7 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:59.695864 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-98cf48ee-e04e-4af4-bfc0-c1895cf177c4 req-4f972091-0a44-471a-86d6-599169d487a7 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:59.707510 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-98cf48ee-e04e-4af4-bfc0-c1895cf177c4 req-4f972091-0a44-471a-86d6-599169d487a7 service nova] Creating event network-vif-deleted:6d0d654f-2f8f-4f17-bf93-aa249db5c6d8 for instance e15bc2b4-4702-4ee5-9483-87db30954da2 on hv-cinder-82660 Aug 09 18:53:59.712586 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-98cf48ee-e04e-4af4-bfc0-c1895cf177c4 req-4f972091-0a44-471a-86d6-599169d487a7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031746 Aug 09 18:53:59.713252 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 308/635] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:53:59.892331 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a6591719-1e25-48a6-92f0-913ef997352d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:53:59.893010 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-a6591719-1e25-48a6-92f0-913ef997352d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:53:59.899079 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a6591719-1e25-48a6-92f0-913ef997352d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:59.899579 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a6591719-1e25-48a6-92f0-913ef997352d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:59.900009 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a6591719-1e25-48a6-92f0-913ef997352d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:53:59.900707 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a6591719-1e25-48a6-92f0-913ef997352d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:53:59.901187 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a6591719-1e25-48a6-92f0-913ef997352d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:53:59.901611 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a6591719-1e25-48a6-92f0-913ef997352d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:00.039510 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-a6591719-1e25-48a6-92f0-913ef997352d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:00.047062 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-a6591719-1e25-48a6-92f0-913ef997352d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1574 microversion: 2.1 time: 0.158695 Aug 09 18:54:00.047968 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 328/636] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:53:59 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:54:00.218852 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-eeee418e-1692-4dbb-b312-1702f37a04cd tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:00.219498 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-eeee418e-1692-4dbb-b312-1702f37a04cd tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:00.225589 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-eeee418e-1692-4dbb-b312-1702f37a04cd tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:00.226080 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-eeee418e-1692-4dbb-b312-1702f37a04cd tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:00.226517 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-eeee418e-1692-4dbb-b312-1702f37a04cd tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:00.227211 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-eeee418e-1692-4dbb-b312-1702f37a04cd tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:00.227660 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-eeee418e-1692-4dbb-b312-1702f37a04cd tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:00.228086 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-eeee418e-1692-4dbb-b312-1702f37a04cd tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:00.259994 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-eeee418e-1692-4dbb-b312-1702f37a04cd tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:00.260476 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-eeee418e-1692-4dbb-b312-1702f37a04cd tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:00.261422 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-eeee418e-1692-4dbb-b312-1702f37a04cd tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:00.261898 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.objects.instance [None req-eeee418e-1692-4dbb-b312-1702f37a04cd tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lazy-loading 'fault' on Instance uuid e15bc2b4-4702-4ee5-9483-87db30954da2 {{(pid=124726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:54:00.308233 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-eeee418e-1692-4dbb-b312-1702f37a04cd tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:00.315888 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-eeee418e-1692-4dbb-b312-1702f37a04cd tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2" status: 200 len: 1335 microversion: 2.1 time: 0.101957 Aug 09 18:54:00.316588 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 309/637] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:54:00 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2 => generated 1335 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:54:01.069075 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-88efbd08-533c-4d4b-a7b7-7a57dfc31f1c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:01.069720 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-88efbd08-533c-4d4b-a7b7-7a57dfc31f1c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:01.076707 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-88efbd08-533c-4d4b-a7b7-7a57dfc31f1c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:01.077130 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-88efbd08-533c-4d4b-a7b7-7a57dfc31f1c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:01.077596 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-88efbd08-533c-4d4b-a7b7-7a57dfc31f1c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:01.078295 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-88efbd08-533c-4d4b-a7b7-7a57dfc31f1c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:01.078753 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-88efbd08-533c-4d4b-a7b7-7a57dfc31f1c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:01.079176 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-88efbd08-533c-4d4b-a7b7-7a57dfc31f1c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:01.213434 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-88efbd08-533c-4d4b-a7b7-7a57dfc31f1c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:01.221533 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-88efbd08-533c-4d4b-a7b7-7a57dfc31f1c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1574 microversion: 2.1 time: 0.156379 Aug 09 18:54:01.222113 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 329/638] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:54:01 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:54:01.391801 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-4d2789ea-2835-420b-a238-ae421189fcd2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:01.392415 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-4d2789ea-2835-420b-a238-ae421189fcd2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: e15bc2b4-4702-4ee5-9483-87db30954da2] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:01.398682 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4d2789ea-2835-420b-a238-ae421189fcd2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:01.399166 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4d2789ea-2835-420b-a238-ae421189fcd2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:01.399599 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4d2789ea-2835-420b-a238-ae421189fcd2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:01.400294 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4d2789ea-2835-420b-a238-ae421189fcd2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:01.400746 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4d2789ea-2835-420b-a238-ae421189fcd2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:01.401174 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4d2789ea-2835-420b-a238-ae421189fcd2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:01.414394 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.wsgi [None req-4d2789ea-2835-420b-a238-ae421189fcd2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] HTTP exception thrown: Instance e15bc2b4-4702-4ee5-9483-87db30954da2 could not be found. Aug 09 18:54:01.416027 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-4d2789ea-2835-420b-a238-ae421189fcd2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Request method failure captured: Aug 09 18:54:01.416027 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: request: GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2 HTTP/1.1 Aug 09 18:54:01.416027 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept: application/json Aug 09 18:54:01.416027 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept-Encoding: identity Aug 09 18:54:01.416027 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Connection: close Aug 09 18:54:01.416027 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Length: 0 Aug 09 18:54:01.416027 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Type: application/json Aug 09 18:54:01.416027 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Host: 10.222.0.57 Aug 09 18:54:01.416027 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Openstack-System-Scope: None Aug 09 18:54:01.416027 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: User-Agent: python-urllib3/1.26.11 Aug 09 18:54:01.416027 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Auth-Token: gAAAAABi8qwcYn_PR1bY-m21eiDaM-K65e27GCgB1hyw1OuGXRk37b51HFhla9CV-9Ypj2nAUtt--h-xdiAP9q3XcmfWWUfjCi-I0NaYuSy2aQQRGG3_zykXOBy5GJW4FO-NWWjB3ENfbKd8Tz-WldjUgCB_nawpLyJ7FUR9ShKkFO_khGgJwfI Aug 09 18:54:01.416027 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Id: None Aug 09 18:54:01.416027 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Name: None Aug 09 18:54:01.416027 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Identity-Status: Confirmed Aug 09 18:54:01.416027 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Is-Admin-Project: True Aug 09 18:54:01.416027 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Id: default Aug 09 18:54:01.416027 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Name: Default Aug 09 18:54:01.416027 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Id: d3c7915d78334e95a41a32f0f3b5b084 Aug 09 18:54:01.416027 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-687112300 Aug 09 18:54:01.416027 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Role: reader,member Aug 09 18:54:01.416027 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Roles: reader,member Aug 09 18:54:01.417615 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d3c7915d78334e95a41a32f0f3b5b084", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d3c7915d78334e95a41a32f0f3b5b084"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d3c7915d78334e95a41a32f0f3b5b084"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d3c7915d78334e95a41a32f0f3b5b084"}]}] Aug 09 18:54:01.417615 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant: tempest-ServerRescueNegativeTestJSON-687112300 Aug 09 18:54:01.417615 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Id: d3c7915d78334e95a41a32f0f3b5b084 Aug 09 18:54:01.417615 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-687112300 Aug 09 18:54:01.417615 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User: tempest-ServerRescueNegativeTestJSON-687112300-project Aug 09 18:54:01.417615 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Id: default Aug 09 18:54:01.417615 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Name: Default Aug 09 18:54:01.417615 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Id: 04da0f4276d6457c889ecb3006842e9c Aug 09 18:54:01.417615 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Name: tempest-ServerRescueNegativeTestJSON-687112300-project Aug 09 18:54:01.417615 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: method: > Aug 09 18:54:01.417615 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: exception: Instance e15bc2b4-4702-4ee5-9483-87db30954da2 could not be found. Aug 09 18:54:01.417615 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: action_args: {'id': 'e15bc2b4-4702-4ee5-9483-87db30954da2'} Aug 09 18:54:01.418499 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:54:01.418499 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:54:01.418499 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:54:01.418499 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:54:01.418499 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:54:01.418499 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:54:01.418499 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:54:01.418499 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:54:01.418499 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:54:01.418499 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:54:01.418499 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e15bc2b4-4702-4ee5-9483-87db30954da2 could not be found. Aug 09 18:54:01.418499 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:54:01.418499 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:54:01.418499 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:54:01.418499 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:54:01.418499 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:54:01.418499 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:54:01.418499 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:54:01.418499 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:54:01.418499 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:54:01.420004 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:54:01.420004 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:54:01.420004 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:54:01.420004 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:54:01.420004 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:54:01.420004 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:54:01.420004 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:54:01.420004 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e15bc2b4-4702-4ee5-9483-87db30954da2 could not be found. Aug 09 18:54:01.420004 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:54:01.420004 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:54:01.420004 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:54:01.420004 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:54:01.420004 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:54:01.420004 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:54:01.420004 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:54:01.420004 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:54:01.420004 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e15bc2b4-4702-4ee5-9483-87db30954da2 could not be found. Aug 09 18:54:01.420004 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:54:01.421278 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-4d2789ea-2835-420b-a238-ae421189fcd2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Returning 404 to user: Instance e15bc2b4-4702-4ee5-9483-87db30954da2 could not be found. {{(pid=124726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:54:01.421278 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-4d2789ea-2835-420b-a238-ae421189fcd2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2" status: 404 len: 111 microversion: 2.1 time: 0.085067 Aug 09 18:54:01.421278 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 310/639] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:54:01 2022] GET /compute/v2.1/servers/e15bc2b4-4702-4ee5-9483-87db30954da2 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:54:01.426469 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b5817d15-70e0-4e56-8a6f-b08b046caaf2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '.version_select at 0x7f8d6956d5e0>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:01.499844 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-b5817d15-70e0-4e56-8a6f-b08b046caaf2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1410633890" status: 202 len: 0 microversion: 2.1 time: 0.077112 Aug 09 18:54:01.500410 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 330/640] 10.222.0.57 () {58 vars in 1221 bytes} [Tue Aug 9 18:54:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1410633890 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:54:02.242380 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-61ea1375-578d-44a5-a9fa-63f4d5dd71f3 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:02.242978 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-61ea1375-578d-44a5-a9fa-63f4d5dd71f3 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:02.249289 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-61ea1375-578d-44a5-a9fa-63f4d5dd71f3 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:02.249620 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-61ea1375-578d-44a5-a9fa-63f4d5dd71f3 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:02.250425 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-61ea1375-578d-44a5-a9fa-63f4d5dd71f3 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:02.250853 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-61ea1375-578d-44a5-a9fa-63f4d5dd71f3 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:02.251457 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-61ea1375-578d-44a5-a9fa-63f4d5dd71f3 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:02.251744 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-61ea1375-578d-44a5-a9fa-63f4d5dd71f3 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:02.388893 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-61ea1375-578d-44a5-a9fa-63f4d5dd71f3 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:02.396982 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-61ea1375-578d-44a5-a9fa-63f4d5dd71f3 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1574 microversion: 2.1 time: 0.158344 Aug 09 18:54:02.397619 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 311/641] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:54:02 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:54:03.420457 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-0b16dd59-bdbe-414e-95d9-f2bfabae0b35 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:03.421047 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-0b16dd59-bdbe-414e-95d9-f2bfabae0b35 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:03.427129 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0b16dd59-bdbe-414e-95d9-f2bfabae0b35 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:03.427602 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0b16dd59-bdbe-414e-95d9-f2bfabae0b35 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:03.428031 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0b16dd59-bdbe-414e-95d9-f2bfabae0b35 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:03.428721 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0b16dd59-bdbe-414e-95d9-f2bfabae0b35 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:03.429169 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0b16dd59-bdbe-414e-95d9-f2bfabae0b35 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:03.429616 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0b16dd59-bdbe-414e-95d9-f2bfabae0b35 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:03.448625 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:54:03.568353 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-0b16dd59-bdbe-414e-95d9-f2bfabae0b35 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:03.575843 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-0b16dd59-bdbe-414e-95d9-f2bfabae0b35 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1574 microversion: 2.1 time: 0.160926 Aug 09 18:54:03.576593 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 331/642] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:54:03 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:54:04.597649 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-b26294bd-f31a-4359-8bd4-eb6a7db8cd81 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:04.598257 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-b26294bd-f31a-4359-8bd4-eb6a7db8cd81 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:04.605098 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b26294bd-f31a-4359-8bd4-eb6a7db8cd81 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:04.605593 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b26294bd-f31a-4359-8bd4-eb6a7db8cd81 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:04.606065 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b26294bd-f31a-4359-8bd4-eb6a7db8cd81 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:04.606749 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b26294bd-f31a-4359-8bd4-eb6a7db8cd81 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:04.607191 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b26294bd-f31a-4359-8bd4-eb6a7db8cd81 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:04.607604 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b26294bd-f31a-4359-8bd4-eb6a7db8cd81 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:04.739653 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-b26294bd-f31a-4359-8bd4-eb6a7db8cd81 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:04.746768 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a7a9664a-3c76-4397-99ac-713930095dd2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:04.747308 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-a7a9664a-3c76-4397-99ac-713930095dd2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:04.747517 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-b26294bd-f31a-4359-8bd4-eb6a7db8cd81 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1574 microversion: 2.1 time: 0.153830 Aug 09 18:54:04.748088 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 312/643] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:54:04 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:54:04.753806 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a7a9664a-3c76-4397-99ac-713930095dd2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:04.754281 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a7a9664a-3c76-4397-99ac-713930095dd2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:04.754708 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a7a9664a-3c76-4397-99ac-713930095dd2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:04.755392 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a7a9664a-3c76-4397-99ac-713930095dd2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:04.755838 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a7a9664a-3c76-4397-99ac-713930095dd2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:04.756263 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a7a9664a-3c76-4397-99ac-713930095dd2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:04.781615 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-a7a9664a-3c76-4397-99ac-713930095dd2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Going to try to terminate instance {{(pid=124725) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:54:05.030525 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-a7a9664a-3c76-4397-99ac-713930095dd2 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 204 len: 0 microversion: 2.1 time: 0.287536 Aug 09 18:54:05.031036 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 332/644] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 9 18:54:04 2022] DELETE /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 18:54:05.038895 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-ba12f1e3-146f-41e3-90ba-3547005c093c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:05.039502 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-ba12f1e3-146f-41e3-90ba-3547005c093c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:05.045441 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ba12f1e3-146f-41e3-90ba-3547005c093c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:05.045945 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ba12f1e3-146f-41e3-90ba-3547005c093c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:05.046375 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ba12f1e3-146f-41e3-90ba-3547005c093c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:05.047068 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ba12f1e3-146f-41e3-90ba-3547005c093c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:05.047496 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ba12f1e3-146f-41e3-90ba-3547005c093c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:05.047910 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ba12f1e3-146f-41e3-90ba-3547005c093c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:05.175639 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-ba12f1e3-146f-41e3-90ba-3547005c093c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:05.183229 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-ba12f1e3-146f-41e3-90ba-3547005c093c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1508 microversion: 2.1 time: 0.148064 Aug 09 18:54:05.183800 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 313/645] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:54:05 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:54:05.769837 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-4a165956-d545-4dec-a622-524307581792 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:05.770442 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-4a165956-d545-4dec-a622-524307581792 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:05.777591 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4a165956-d545-4dec-a622-524307581792 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:05.778075 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4a165956-d545-4dec-a622-524307581792 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:05.778509 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4a165956-d545-4dec-a622-524307581792 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:05.779313 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4a165956-d545-4dec-a622-524307581792 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:05.779765 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4a165956-d545-4dec-a622-524307581792 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:05.780220 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4a165956-d545-4dec-a622-524307581792 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:05.923082 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-4a165956-d545-4dec-a622-524307581792 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:05.930469 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-4a165956-d545-4dec-a622-524307581792 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1574 microversion: 2.1 time: 0.165313 Aug 09 18:54:05.931319 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 333/646] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:54:05 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:54:06.204185 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-bd3f0c61-1596-43d9-9d60-4321ac0f7160 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:06.204821 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-bd3f0c61-1596-43d9-9d60-4321ac0f7160 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:06.211286 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-bd3f0c61-1596-43d9-9d60-4321ac0f7160 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:06.211765 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-bd3f0c61-1596-43d9-9d60-4321ac0f7160 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:06.212229 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-bd3f0c61-1596-43d9-9d60-4321ac0f7160 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:06.212911 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-bd3f0c61-1596-43d9-9d60-4321ac0f7160 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:06.213361 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-bd3f0c61-1596-43d9-9d60-4321ac0f7160 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:06.214415 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-bd3f0c61-1596-43d9-9d60-4321ac0f7160 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:06.345856 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-bd3f0c61-1596-43d9-9d60-4321ac0f7160 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:06.353273 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-bd3f0c61-1596-43d9-9d60-4321ac0f7160 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1508 microversion: 2.1 time: 0.152968 Aug 09 18:54:06.353874 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 314/647] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:54:06 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:54:06.660905 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e47941e5-42ec-4e0d-b2ad-ef0f04288514 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:06.661411 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e47941e5-42ec-4e0d-b2ad-ef0f04288514 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:06.668118 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e47941e5-42ec-4e0d-b2ad-ef0f04288514 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:06.668605 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e47941e5-42ec-4e0d-b2ad-ef0f04288514 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:06.669042 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e47941e5-42ec-4e0d-b2ad-ef0f04288514 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:06.669767 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e47941e5-42ec-4e0d-b2ad-ef0f04288514 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:06.670227 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e47941e5-42ec-4e0d-b2ad-ef0f04288514 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:06.670649 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e47941e5-42ec-4e0d-b2ad-ef0f04288514 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:06.693422 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e47941e5-42ec-4e0d-b2ad-ef0f04288514 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631/ips" status: 200 len: 151 microversion: 2.20 time: 0.089109 Aug 09 18:54:06.694010 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 334/648] 10.222.0.57 () {60 vars in 1289 bytes} [Tue Aug 9 18:54:06 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631/ips => generated 151 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:54:06.952094 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-0c3b2fec-4745-43e8-b97a-5674897a297b tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:06.952763 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-0c3b2fec-4745-43e8-b97a-5674897a297b tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:06.958789 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0c3b2fec-4745-43e8-b97a-5674897a297b tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:06.959261 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0c3b2fec-4745-43e8-b97a-5674897a297b tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:06.959687 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0c3b2fec-4745-43e8-b97a-5674897a297b tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:06.960361 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0c3b2fec-4745-43e8-b97a-5674897a297b tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:06.960805 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0c3b2fec-4745-43e8-b97a-5674897a297b tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:06.961234 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0c3b2fec-4745-43e8-b97a-5674897a297b tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:07.093106 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-0c3b2fec-4745-43e8-b97a-5674897a297b tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:07.096616 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:54:07.101111 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-0c3b2fec-4745-43e8-b97a-5674897a297b tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1574 microversion: 2.1 time: 0.153411 Aug 09 18:54:07.104566 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 315/649] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:54:06 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:54:07.374457 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-4d301d0f-18cd-4242-9184-c9b5031aac87 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:07.375072 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-4d301d0f-18cd-4242-9184-c9b5031aac87 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:07.381476 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4d301d0f-18cd-4242-9184-c9b5031aac87 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:07.382065 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4d301d0f-18cd-4242-9184-c9b5031aac87 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:07.382501 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4d301d0f-18cd-4242-9184-c9b5031aac87 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:07.383197 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4d301d0f-18cd-4242-9184-c9b5031aac87 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:07.383657 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4d301d0f-18cd-4242-9184-c9b5031aac87 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:07.384085 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4d301d0f-18cd-4242-9184-c9b5031aac87 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:07.516134 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-4d301d0f-18cd-4242-9184-c9b5031aac87 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:07.523482 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-4d301d0f-18cd-4242-9184-c9b5031aac87 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1508 microversion: 2.1 time: 0.153379 Aug 09 18:54:07.524189 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 335/650] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:54:07 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:54:08.122585 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-095e57f4-c33c-461e-9e88-f089e08539e8 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:08.123232 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-095e57f4-c33c-461e-9e88-f089e08539e8 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:08.130424 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-095e57f4-c33c-461e-9e88-f089e08539e8 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:08.130917 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-095e57f4-c33c-461e-9e88-f089e08539e8 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:08.131351 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-095e57f4-c33c-461e-9e88-f089e08539e8 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:08.132055 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-095e57f4-c33c-461e-9e88-f089e08539e8 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:08.132512 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-095e57f4-c33c-461e-9e88-f089e08539e8 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:08.132938 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-095e57f4-c33c-461e-9e88-f089e08539e8 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:08.351981 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-095e57f4-c33c-461e-9e88-f089e08539e8 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:08.360188 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-095e57f4-c33c-461e-9e88-f089e08539e8 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1574 microversion: 2.1 time: 0.241436 Aug 09 18:54:08.360760 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 316/651] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:54:08 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1574 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:54:08.544283 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e0b6c26d-1d17-491c-be9c-bace20469421 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:08.544897 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e0b6c26d-1d17-491c-be9c-bace20469421 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:08.551352 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e0b6c26d-1d17-491c-be9c-bace20469421 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:08.551838 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e0b6c26d-1d17-491c-be9c-bace20469421 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:08.552276 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e0b6c26d-1d17-491c-be9c-bace20469421 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:08.552979 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e0b6c26d-1d17-491c-be9c-bace20469421 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:08.553430 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e0b6c26d-1d17-491c-be9c-bace20469421 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:08.553884 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e0b6c26d-1d17-491c-be9c-bace20469421 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:08.627904 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e0b6c26d-1d17-491c-be9c-bace20469421 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:08.638826 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e0b6c26d-1d17-491c-be9c-bace20469421 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 200 len: 1466 microversion: 2.1 time: 0.098425 Aug 09 18:54:08.649687 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 336/652] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:54:08 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 1466 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:54:08.664003 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-842c9b7b-ada1-49d7-97a4-5021e3e98e4d req-70e4e61b-4f09-44ca-b99a-2033b9de7177 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9ba973a-a274-418c-aa03-1f22b8bd8b37", "name": "network-vif-deleted", "tag": "eff4b1ff-04ab-46a2-a8e4-5d8ff9b6e64a"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:54:08.673648 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-842c9b7b-ada1-49d7-97a4-5021e3e98e4d req-70e4e61b-4f09-44ca-b99a-2033b9de7177 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:08.674240 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-842c9b7b-ada1-49d7-97a4-5021e3e98e4d req-70e4e61b-4f09-44ca-b99a-2033b9de7177 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:08.674733 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-842c9b7b-ada1-49d7-97a4-5021e3e98e4d req-70e4e61b-4f09-44ca-b99a-2033b9de7177 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:08.686168 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-842c9b7b-ada1-49d7-97a4-5021e3e98e4d req-70e4e61b-4f09-44ca-b99a-2033b9de7177 service nova] Creating event network-vif-deleted:eff4b1ff-04ab-46a2-a8e4-5d8ff9b6e64a for instance d9ba973a-a274-418c-aa03-1f22b8bd8b37 on hv-cinder-82660 Aug 09 18:54:08.691227 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-842c9b7b-ada1-49d7-97a4-5021e3e98e4d req-70e4e61b-4f09-44ca-b99a-2033b9de7177 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031348 Aug 09 18:54:08.691879 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 317/653] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:54:09.039509 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-656fff4f-a9df-4ad1-bfc7-699729f47338 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:54:09.040092 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-656fff4f-a9df-4ad1-bfc7-699729f47338 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:09.046553 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-656fff4f-a9df-4ad1-bfc7-699729f47338 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:09.047045 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-656fff4f-a9df-4ad1-bfc7-699729f47338 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:09.047485 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-656fff4f-a9df-4ad1-bfc7-699729f47338 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:09.048194 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-656fff4f-a9df-4ad1-bfc7-699729f47338 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:09.048644 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-656fff4f-a9df-4ad1-bfc7-699729f47338 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:09.049063 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-656fff4f-a9df-4ad1-bfc7-699729f47338 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:09.074223 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.objects.instance [None req-656fff4f-a9df-4ad1-bfc7-699729f47338 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lazy-loading 'flavor' on Instance uuid 8f84c5e3-7213-4bd2-ad7c-4794aab9d631 {{(pid=124725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:54:09.384128 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-07002c42-44ac-40b3-a639-407f75fd3690 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:09.389098 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-07002c42-44ac-40b3-a639-407f75fd3690 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:09.392340 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-07002c42-44ac-40b3-a639-407f75fd3690 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:09.392887 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-07002c42-44ac-40b3-a639-407f75fd3690 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:09.393413 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-07002c42-44ac-40b3-a639-407f75fd3690 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:09.394188 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-07002c42-44ac-40b3-a639-407f75fd3690 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:09.394744 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-07002c42-44ac-40b3-a639-407f75fd3690 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:09.395224 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-07002c42-44ac-40b3-a639-407f75fd3690 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:09.537573 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-656fff4f-a9df-4ad1-bfc7-699729f47338 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "POST /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631/action" status: 202 len: 0 microversion: 2.20 time: 0.502064 Aug 09 18:54:09.538809 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 337/654] 10.222.0.57 () {62 vars in 1319 bytes} [Tue Aug 9 18:54:09 2022] POST /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631/action => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:54:09.539176 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-07002c42-44ac-40b3-a639-407f75fd3690 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:09.547303 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-07002c42-44ac-40b3-a639-407f75fd3690 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1574 microversion: 2.1 time: 0.167790 Aug 09 18:54:09.547647 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f89188b4-2658-4c12-8df8-964eeb11f182 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:09.548360 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-f89188b4-2658-4c12-8df8-964eeb11f182 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:09.559578 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f89188b4-2658-4c12-8df8-964eeb11f182 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:09.560070 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f89188b4-2658-4c12-8df8-964eeb11f182 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:09.563741 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f89188b4-2658-4c12-8df8-964eeb11f182 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:09.563741 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f89188b4-2658-4c12-8df8-964eeb11f182 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:09.563741 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f89188b4-2658-4c12-8df8-964eeb11f182 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:09.563741 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f89188b4-2658-4c12-8df8-964eeb11f182 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:09.564218 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 318/655] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:54:09 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1574 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:54:09.663341 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-194077c7-daee-49c4-a68e-4903b742cefc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:09.664216 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-194077c7-daee-49c4-a68e-4903b742cefc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: d9ba973a-a274-418c-aa03-1f22b8bd8b37] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:09.672236 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-194077c7-daee-49c4-a68e-4903b742cefc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:09.672853 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-194077c7-daee-49c4-a68e-4903b742cefc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:09.673509 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-194077c7-daee-49c4-a68e-4903b742cefc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:09.674374 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-194077c7-daee-49c4-a68e-4903b742cefc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:09.675048 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-194077c7-daee-49c4-a68e-4903b742cefc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:09.675603 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-194077c7-daee-49c4-a68e-4903b742cefc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:09.690358 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.wsgi [None req-194077c7-daee-49c4-a68e-4903b742cefc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] HTTP exception thrown: Instance d9ba973a-a274-418c-aa03-1f22b8bd8b37 could not be found. Aug 09 18:54:09.692056 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-194077c7-daee-49c4-a68e-4903b742cefc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Request method failure captured: Aug 09 18:54:09.692056 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: request: GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 HTTP/1.1 Aug 09 18:54:09.692056 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept: application/json Aug 09 18:54:09.692056 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept-Encoding: identity Aug 09 18:54:09.692056 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Connection: close Aug 09 18:54:09.692056 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Length: 0 Aug 09 18:54:09.692056 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Type: application/json Aug 09 18:54:09.692056 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Host: 10.222.0.57 Aug 09 18:54:09.692056 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Openstack-System-Scope: None Aug 09 18:54:09.692056 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: User-Agent: python-urllib3/1.26.11 Aug 09 18:54:09.692056 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Auth-Token: gAAAAABi8qwcYn_PR1bY-m21eiDaM-K65e27GCgB1hyw1OuGXRk37b51HFhla9CV-9Ypj2nAUtt--h-xdiAP9q3XcmfWWUfjCi-I0NaYuSy2aQQRGG3_zykXOBy5GJW4FO-NWWjB3ENfbKd8Tz-WldjUgCB_nawpLyJ7FUR9ShKkFO_khGgJwfI Aug 09 18:54:09.692056 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Id: None Aug 09 18:54:09.692056 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Name: None Aug 09 18:54:09.692056 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Identity-Status: Confirmed Aug 09 18:54:09.692056 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Is-Admin-Project: True Aug 09 18:54:09.692056 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Id: default Aug 09 18:54:09.692056 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Name: Default Aug 09 18:54:09.692056 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Id: d3c7915d78334e95a41a32f0f3b5b084 Aug 09 18:54:09.692056 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-687112300 Aug 09 18:54:09.692056 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Role: reader,member Aug 09 18:54:09.692056 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Roles: reader,member Aug 09 18:54:09.693625 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d3c7915d78334e95a41a32f0f3b5b084", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d3c7915d78334e95a41a32f0f3b5b084"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d3c7915d78334e95a41a32f0f3b5b084"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d3c7915d78334e95a41a32f0f3b5b084"}]}] Aug 09 18:54:09.693625 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant: tempest-ServerRescueNegativeTestJSON-687112300 Aug 09 18:54:09.693625 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Id: d3c7915d78334e95a41a32f0f3b5b084 Aug 09 18:54:09.693625 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-687112300 Aug 09 18:54:09.693625 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User: tempest-ServerRescueNegativeTestJSON-687112300-project Aug 09 18:54:09.693625 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Id: default Aug 09 18:54:09.693625 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Name: Default Aug 09 18:54:09.693625 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Id: 04da0f4276d6457c889ecb3006842e9c Aug 09 18:54:09.693625 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Name: tempest-ServerRescueNegativeTestJSON-687112300-project Aug 09 18:54:09.693625 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: method: > Aug 09 18:54:09.693625 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: exception: Instance d9ba973a-a274-418c-aa03-1f22b8bd8b37 could not be found. Aug 09 18:54:09.693625 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: action_args: {'id': 'd9ba973a-a274-418c-aa03-1f22b8bd8b37'} Aug 09 18:54:09.694406 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:54:09.694406 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:54:09.694406 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:54:09.694406 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:54:09.694406 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:54:09.694406 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:54:09.694406 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:54:09.694406 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:54:09.694406 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:54:09.694406 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:54:09.694406 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9ba973a-a274-418c-aa03-1f22b8bd8b37 could not be found. Aug 09 18:54:09.694406 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:54:09.694406 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:54:09.694406 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:54:09.694406 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:54:09.694406 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:54:09.694406 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:54:09.694406 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:54:09.694406 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:54:09.694406 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:54:09.695632 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:54:09.695632 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:54:09.695632 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:54:09.695632 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:54:09.695632 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:54:09.695632 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:54:09.695632 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:54:09.695632 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9ba973a-a274-418c-aa03-1f22b8bd8b37 could not be found. Aug 09 18:54:09.695632 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:54:09.695632 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:54:09.695632 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:54:09.695632 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:54:09.695632 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:54:09.695632 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:54:09.695632 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:54:09.695632 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:54:09.695632 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9ba973a-a274-418c-aa03-1f22b8bd8b37 could not be found. Aug 09 18:54:09.695632 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:54:09.696765 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-194077c7-daee-49c4-a68e-4903b742cefc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Returning 404 to user: Instance d9ba973a-a274-418c-aa03-1f22b8bd8b37 could not be found. {{(pid=124726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:54:09.696765 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-194077c7-daee-49c4-a68e-4903b742cefc tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37" status: 404 len: 111 microversion: 2.1 time: 0.035231 Aug 09 18:54:09.696765 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 319/656] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:54:09 2022] GET /compute/v2.1/servers/d9ba973a-a274-418c-aa03-1f22b8bd8b37 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:54:09.701433 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f89188b4-2658-4c12-8df8-964eeb11f182 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:09.702331 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-d0258b41-4bf4-4711-a158-2ff296760416 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:09.702833 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-d0258b41-4bf4-4711-a158-2ff296760416 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:09.708701 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d0258b41-4bf4-4711-a158-2ff296760416 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:09.709181 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d0258b41-4bf4-4711-a158-2ff296760416 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:09.709507 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f89188b4-2658-4c12-8df8-964eeb11f182 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:09.709658 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d0258b41-4bf4-4711-a158-2ff296760416 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:09.710343 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d0258b41-4bf4-4711-a158-2ff296760416 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:09.710796 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d0258b41-4bf4-4711-a158-2ff296760416 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:09.711022 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f89188b4-2658-4c12-8df8-964eeb11f182 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:09.711222 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d0258b41-4bf4-4711-a158-2ff296760416 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:09.712167 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f89188b4-2658-4c12-8df8-964eeb11f182 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1723 microversion: 2.20 time: 0.169001 Aug 09 18:54:09.712724 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 338/657] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:54:09 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:54:09.739545 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-d0258b41-4bf4-4711-a158-2ff296760416 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Going to try to terminate instance {{(pid=124726) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:54:09.925610 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:54:09.985266 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-d0258b41-4bf4-4711-a158-2ff296760416 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "DELETE /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 204 len: 0 microversion: 2.1 time: 0.286505 Aug 09 18:54:09.986079 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 320/658] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 9 18:54:09 2022] DELETE /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:54:09.994062 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-4e2c917f-d94f-4e8c-9410-f00158915d62 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:09.994669 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-4e2c917f-d94f-4e8c-9410-f00158915d62 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:10.000784 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4e2c917f-d94f-4e8c-9410-f00158915d62 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:10.001263 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4e2c917f-d94f-4e8c-9410-f00158915d62 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:10.001730 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4e2c917f-d94f-4e8c-9410-f00158915d62 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:10.002416 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4e2c917f-d94f-4e8c-9410-f00158915d62 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:10.002863 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4e2c917f-d94f-4e8c-9410-f00158915d62 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:10.003330 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4e2c917f-d94f-4e8c-9410-f00158915d62 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:10.131666 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-4e2c917f-d94f-4e8c-9410-f00158915d62 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:10.139496 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-4e2c917f-d94f-4e8c-9410-f00158915d62 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1523 microversion: 2.1 time: 0.149272 Aug 09 18:54:10.140061 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 339/659] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:54:09 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:54:10.573032 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-377d988b-3d7b-4463-b9e3-74ece9de4f84 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:10.573762 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-377d988b-3d7b-4463-b9e3-74ece9de4f84 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:10.580668 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-377d988b-3d7b-4463-b9e3-74ece9de4f84 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:10.581159 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-377d988b-3d7b-4463-b9e3-74ece9de4f84 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:10.581689 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-377d988b-3d7b-4463-b9e3-74ece9de4f84 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:10.582749 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-377d988b-3d7b-4463-b9e3-74ece9de4f84 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:10.583210 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-377d988b-3d7b-4463-b9e3-74ece9de4f84 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:10.583642 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-377d988b-3d7b-4463-b9e3-74ece9de4f84 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:10.591316 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-28d88fc7-187d-4a78-82ef-3ad1b8cb80e8 req-0035f78f-58a3-4bae-a1e0-514658ae7f5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7", "name": "network-vif-plugged", "status": "completed", "tag": "f4782f09-a0b0-4715-98fa-ea0d74933d8d"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:54:10.602779 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-28d88fc7-187d-4a78-82ef-3ad1b8cb80e8 req-0035f78f-58a3-4bae-a1e0-514658ae7f5b service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:10.603253 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-28d88fc7-187d-4a78-82ef-3ad1b8cb80e8 req-0035f78f-58a3-4bae-a1e0-514658ae7f5b service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:10.603809 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-28d88fc7-187d-4a78-82ef-3ad1b8cb80e8 req-0035f78f-58a3-4bae-a1e0-514658ae7f5b service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:10.615676 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-28d88fc7-187d-4a78-82ef-3ad1b8cb80e8 req-0035f78f-58a3-4bae-a1e0-514658ae7f5b service nova] Creating event network-vif-plugged:f4782f09-a0b0-4715-98fa-ea0d74933d8d for instance fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 on hv-cinder-82660 Aug 09 18:54:10.620542 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-28d88fc7-187d-4a78-82ef-3ad1b8cb80e8 req-0035f78f-58a3-4bae-a1e0-514658ae7f5b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036329 Aug 09 18:54:10.624559 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 340/660] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:54:10.721143 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-377d988b-3d7b-4463-b9e3-74ece9de4f84 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:10.729027 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-377d988b-3d7b-4463-b9e3-74ece9de4f84 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1574 microversion: 2.1 time: 0.160169 Aug 09 18:54:10.729950 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 321/661] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:54:10 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:54:10.736071 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-952e425c-4f51-4989-99bd-a7a355a3b072 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:10.736763 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-952e425c-4f51-4989-99bd-a7a355a3b072 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:10.742928 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-952e425c-4f51-4989-99bd-a7a355a3b072 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:10.743402 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-952e425c-4f51-4989-99bd-a7a355a3b072 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:10.743833 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-952e425c-4f51-4989-99bd-a7a355a3b072 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:10.744671 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-952e425c-4f51-4989-99bd-a7a355a3b072 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:10.745123 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-952e425c-4f51-4989-99bd-a7a355a3b072 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:10.745563 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-952e425c-4f51-4989-99bd-a7a355a3b072 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:10.877326 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-952e425c-4f51-4989-99bd-a7a355a3b072 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:10.886427 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-952e425c-4f51-4989-99bd-a7a355a3b072 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:10.887983 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-952e425c-4f51-4989-99bd-a7a355a3b072 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:10.889188 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-952e425c-4f51-4989-99bd-a7a355a3b072 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1723 microversion: 2.20 time: 0.157825 Aug 09 18:54:10.889830 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 341/662] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:54:10 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:54:11.160903 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-44bc39fb-6626-42e0-b94a-82623a140df8 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:11.161421 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-44bc39fb-6626-42e0-b94a-82623a140df8 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:11.169281 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-44bc39fb-6626-42e0-b94a-82623a140df8 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:11.169281 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-44bc39fb-6626-42e0-b94a-82623a140df8 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:11.169281 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-44bc39fb-6626-42e0-b94a-82623a140df8 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:11.169721 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-44bc39fb-6626-42e0-b94a-82623a140df8 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:11.170171 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-44bc39fb-6626-42e0-b94a-82623a140df8 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:11.170598 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-44bc39fb-6626-42e0-b94a-82623a140df8 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:11.546404 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-44bc39fb-6626-42e0-b94a-82623a140df8 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:11.553880 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-44bc39fb-6626-42e0-b94a-82623a140df8 tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1523 microversion: 2.1 time: 0.396997 Aug 09 18:54:11.554443 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 322/663] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:54:11 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1523 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:54:11.750231 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-46ff0d0a-7d1a-4137-9f76-07e739ffaa84 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:11.750877 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-46ff0d0a-7d1a-4137-9f76-07e739ffaa84 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:11.753426 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:54:11.758222 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-46ff0d0a-7d1a-4137-9f76-07e739ffaa84 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:11.758749 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-46ff0d0a-7d1a-4137-9f76-07e739ffaa84 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:11.759209 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-46ff0d0a-7d1a-4137-9f76-07e739ffaa84 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:11.759902 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-46ff0d0a-7d1a-4137-9f76-07e739ffaa84 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:11.760401 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-46ff0d0a-7d1a-4137-9f76-07e739ffaa84 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:11.761372 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-46ff0d0a-7d1a-4137-9f76-07e739ffaa84 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:11.900776 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-46ff0d0a-7d1a-4137-9f76-07e739ffaa84 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:11.908395 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-46ff0d0a-7d1a-4137-9f76-07e739ffaa84 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1574 microversion: 2.1 time: 0.162136 Aug 09 18:54:11.908968 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 342/664] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:54:11 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:54:11.912568 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-724bfa48-fa3f-4658-aa9e-87f5958ff60a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:11.913176 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-724bfa48-fa3f-4658-aa9e-87f5958ff60a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:11.919683 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-724bfa48-fa3f-4658-aa9e-87f5958ff60a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:11.920160 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-724bfa48-fa3f-4658-aa9e-87f5958ff60a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:11.920626 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-724bfa48-fa3f-4658-aa9e-87f5958ff60a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:11.921310 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-724bfa48-fa3f-4658-aa9e-87f5958ff60a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:11.921788 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-724bfa48-fa3f-4658-aa9e-87f5958ff60a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:11.922211 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-724bfa48-fa3f-4658-aa9e-87f5958ff60a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:12.050055 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-724bfa48-fa3f-4658-aa9e-87f5958ff60a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:12.058759 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-724bfa48-fa3f-4658-aa9e-87f5958ff60a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:12.060243 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-724bfa48-fa3f-4658-aa9e-87f5958ff60a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:12.061395 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-724bfa48-fa3f-4658-aa9e-87f5958ff60a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1723 microversion: 2.20 time: 0.153130 Aug 09 18:54:12.061990 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 323/665] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:54:11 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:54:12.575077 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-daa9879a-ad14-4e4b-85d3-8a63579dbbdd tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:12.575688 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-daa9879a-ad14-4e4b-85d3-8a63579dbbdd tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:12.581844 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-daa9879a-ad14-4e4b-85d3-8a63579dbbdd tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:12.582326 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-daa9879a-ad14-4e4b-85d3-8a63579dbbdd tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:12.582758 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-daa9879a-ad14-4e4b-85d3-8a63579dbbdd tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:12.583453 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-daa9879a-ad14-4e4b-85d3-8a63579dbbdd tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:12.583906 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-daa9879a-ad14-4e4b-85d3-8a63579dbbdd tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:12.584330 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-daa9879a-ad14-4e4b-85d3-8a63579dbbdd tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:12.714710 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-daa9879a-ad14-4e4b-85d3-8a63579dbbdd tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:12.722159 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-daa9879a-ad14-4e4b-85d3-8a63579dbbdd tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1523 microversion: 2.1 time: 0.151139 Aug 09 18:54:12.722732 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 343/666] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:54:12 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:54:12.929411 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-f783aaf2-f71a-484c-a97b-8e7997a219e2 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:12.929986 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-f783aaf2-f71a-484c-a97b-8e7997a219e2 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:12.936351 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f783aaf2-f71a-484c-a97b-8e7997a219e2 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:12.936827 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f783aaf2-f71a-484c-a97b-8e7997a219e2 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:12.937260 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f783aaf2-f71a-484c-a97b-8e7997a219e2 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:12.938140 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f783aaf2-f71a-484c-a97b-8e7997a219e2 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:12.938617 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f783aaf2-f71a-484c-a97b-8e7997a219e2 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:12.939015 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f783aaf2-f71a-484c-a97b-8e7997a219e2 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:13.071111 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-f783aaf2-f71a-484c-a97b-8e7997a219e2 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:13.078986 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-f783aaf2-f71a-484c-a97b-8e7997a219e2 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1574 microversion: 2.1 time: 0.153491 Aug 09 18:54:13.079555 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 324/667] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:54:12 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:54:13.084622 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-54ed1c4d-7734-4f2b-b06f-4f6b2e93a728 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:13.085229 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-54ed1c4d-7734-4f2b-b06f-4f6b2e93a728 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:13.091506 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-54ed1c4d-7734-4f2b-b06f-4f6b2e93a728 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:13.091978 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-54ed1c4d-7734-4f2b-b06f-4f6b2e93a728 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:13.109993 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-54ed1c4d-7734-4f2b-b06f-4f6b2e93a728 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:13.109993 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-54ed1c4d-7734-4f2b-b06f-4f6b2e93a728 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:13.109993 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-54ed1c4d-7734-4f2b-b06f-4f6b2e93a728 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:13.109993 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-54ed1c4d-7734-4f2b-b06f-4f6b2e93a728 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:13.437471 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-54ed1c4d-7734-4f2b-b06f-4f6b2e93a728 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:13.447509 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-54ed1c4d-7734-4f2b-b06f-4f6b2e93a728 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:13.449034 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-54ed1c4d-7734-4f2b-b06f-4f6b2e93a728 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:13.450335 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-54ed1c4d-7734-4f2b-b06f-4f6b2e93a728 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1723 microversion: 2.20 time: 0.369736 Aug 09 18:54:13.451150 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 344/668] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:54:13 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1723 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:54:13.743242 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-fdadc4de-9204-4868-a968-57b8651f717d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:13.743851 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-fdadc4de-9204-4868-a968-57b8651f717d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:13.749789 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fdadc4de-9204-4868-a968-57b8651f717d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:13.750272 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fdadc4de-9204-4868-a968-57b8651f717d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:13.750709 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fdadc4de-9204-4868-a968-57b8651f717d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:13.751400 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fdadc4de-9204-4868-a968-57b8651f717d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:13.751856 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fdadc4de-9204-4868-a968-57b8651f717d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:13.752283 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fdadc4de-9204-4868-a968-57b8651f717d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:13.973231 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-fdadc4de-9204-4868-a968-57b8651f717d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:13.980877 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-fdadc4de-9204-4868-a968-57b8651f717d tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1523 microversion: 2.1 time: 0.241422 Aug 09 18:54:13.981453 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 325/669] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:54:13 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1523 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:54:14.099162 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-9a21c88e-81d9-4eb1-9118-fe65d6d6f6ba tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:14.099766 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-9a21c88e-81d9-4eb1-9118-fe65d6d6f6ba tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:14.106688 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9a21c88e-81d9-4eb1-9118-fe65d6d6f6ba tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:14.107170 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9a21c88e-81d9-4eb1-9118-fe65d6d6f6ba tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:14.110112 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9a21c88e-81d9-4eb1-9118-fe65d6d6f6ba tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:14.110112 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9a21c88e-81d9-4eb1-9118-fe65d6d6f6ba tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:14.110112 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9a21c88e-81d9-4eb1-9118-fe65d6d6f6ba tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:14.110112 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9a21c88e-81d9-4eb1-9118-fe65d6d6f6ba tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:14.129333 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:54:14.245679 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-b6e71054-676c-43f8-9db6-658b76b5e978 req-871d1ac8-5ffe-429b-b003-69ec99ad08d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "650af48c-836d-4078-abb6-4b865a22a7d8", "name": "network-vif-deleted", "tag": "7c5b913a-9f7f-4626-bc52-5a16cb854f28"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:54:14.253295 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-9a21c88e-81d9-4eb1-9118-fe65d6d6f6ba tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:14.255308 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-b6e71054-676c-43f8-9db6-658b76b5e978 req-871d1ac8-5ffe-429b-b003-69ec99ad08d6 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:14.255798 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-b6e71054-676c-43f8-9db6-658b76b5e978 req-871d1ac8-5ffe-429b-b003-69ec99ad08d6 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:14.256227 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-b6e71054-676c-43f8-9db6-658b76b5e978 req-871d1ac8-5ffe-429b-b003-69ec99ad08d6 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:14.266472 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-9a21c88e-81d9-4eb1-9118-fe65d6d6f6ba tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1574 microversion: 2.1 time: 0.171002 Aug 09 18:54:14.267055 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 345/670] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:54:14 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:54:14.272822 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-b6e71054-676c-43f8-9db6-658b76b5e978 req-871d1ac8-5ffe-429b-b003-69ec99ad08d6 service nova] Creating event network-vif-deleted:7c5b913a-9f7f-4626-bc52-5a16cb854f28 for instance 650af48c-836d-4078-abb6-4b865a22a7d8 on hv-cinder-82660 Aug 09 18:54:14.273476 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-b6e71054-676c-43f8-9db6-658b76b5e978 req-871d1ac8-5ffe-429b-b003-69ec99ad08d6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031210 Aug 09 18:54:14.273836 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 326/671] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:54:14.475841 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-45d0ab0f-4c6d-4f36-9cef-60eac47cb047 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:14.476334 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-45d0ab0f-4c6d-4f36-9cef-60eac47cb047 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:14.482287 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-45d0ab0f-4c6d-4f36-9cef-60eac47cb047 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:14.482764 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-45d0ab0f-4c6d-4f36-9cef-60eac47cb047 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:14.483192 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-45d0ab0f-4c6d-4f36-9cef-60eac47cb047 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:14.483878 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-45d0ab0f-4c6d-4f36-9cef-60eac47cb047 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:14.484328 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-45d0ab0f-4c6d-4f36-9cef-60eac47cb047 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:14.484753 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-45d0ab0f-4c6d-4f36-9cef-60eac47cb047 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:14.623763 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-45d0ab0f-4c6d-4f36-9cef-60eac47cb047 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:14.632923 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-45d0ab0f-4c6d-4f36-9cef-60eac47cb047 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:14.634600 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-45d0ab0f-4c6d-4f36-9cef-60eac47cb047 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:14.636511 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-45d0ab0f-4c6d-4f36-9cef-60eac47cb047 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1723 microversion: 2.20 time: 0.164495 Aug 09 18:54:14.637566 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 346/672] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:54:14 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:54:15.002911 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-c4357a9b-56dd-4fb7-9217-09879bf6016c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:15.003614 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-c4357a9b-56dd-4fb7-9217-09879bf6016c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:15.009949 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c4357a9b-56dd-4fb7-9217-09879bf6016c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:15.011233 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c4357a9b-56dd-4fb7-9217-09879bf6016c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:15.011233 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c4357a9b-56dd-4fb7-9217-09879bf6016c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:15.011581 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c4357a9b-56dd-4fb7-9217-09879bf6016c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:15.012031 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c4357a9b-56dd-4fb7-9217-09879bf6016c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:15.012453 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c4357a9b-56dd-4fb7-9217-09879bf6016c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:15.044975 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c4357a9b-56dd-4fb7-9217-09879bf6016c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:15.045453 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c4357a9b-56dd-4fb7-9217-09879bf6016c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:15.045907 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c4357a9b-56dd-4fb7-9217-09879bf6016c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:15.046349 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.objects.instance [None req-c4357a9b-56dd-4fb7-9217-09879bf6016c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lazy-loading 'fault' on Instance uuid 650af48c-836d-4078-abb6-4b865a22a7d8 {{(pid=124726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:54:15.089585 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-c4357a9b-56dd-4fb7-9217-09879bf6016c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04da0f4276d6457c889ecb3006842e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c7915d78334e95a41a32f0f3b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:15.096877 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-c4357a9b-56dd-4fb7-9217-09879bf6016c tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 200 len: 1312 microversion: 2.1 time: 0.098950 Aug 09 18:54:15.097447 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 327/673] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:54:14 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 1312 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:54:15.288113 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b2b16f1d-91d7-488b-8228-d1f0d9dad08e tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:15.288712 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-b2b16f1d-91d7-488b-8228-d1f0d9dad08e tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:15.295091 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b2b16f1d-91d7-488b-8228-d1f0d9dad08e tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:15.295559 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b2b16f1d-91d7-488b-8228-d1f0d9dad08e tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:15.295991 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b2b16f1d-91d7-488b-8228-d1f0d9dad08e tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:15.296663 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b2b16f1d-91d7-488b-8228-d1f0d9dad08e tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:15.297108 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b2b16f1d-91d7-488b-8228-d1f0d9dad08e tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:15.297551 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b2b16f1d-91d7-488b-8228-d1f0d9dad08e tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:15.431865 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-b2b16f1d-91d7-488b-8228-d1f0d9dad08e tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:15.440252 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-b2b16f1d-91d7-488b-8228-d1f0d9dad08e tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1561 microversion: 2.1 time: 0.155942 Aug 09 18:54:15.440848 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 347/674] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:54:15 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:54:15.660100 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-b71bde84-719c-49cd-839a-0b2b997676f7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:15.660692 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-b71bde84-719c-49cd-839a-0b2b997676f7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:15.666703 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b71bde84-719c-49cd-839a-0b2b997676f7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:15.667807 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b71bde84-719c-49cd-839a-0b2b997676f7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:15.668243 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b71bde84-719c-49cd-839a-0b2b997676f7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:15.668927 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b71bde84-719c-49cd-839a-0b2b997676f7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:15.669380 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b71bde84-719c-49cd-839a-0b2b997676f7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:15.669866 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b71bde84-719c-49cd-839a-0b2b997676f7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:15.804810 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-b71bde84-719c-49cd-839a-0b2b997676f7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:15.813352 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-b71bde84-719c-49cd-839a-0b2b997676f7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:15.814904 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-b71bde84-719c-49cd-839a-0b2b997676f7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:15.816030 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-b71bde84-719c-49cd-839a-0b2b997676f7 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1723 microversion: 2.20 time: 0.160131 Aug 09 18:54:15.816594 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 328/675] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:54:15 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:54:16.118962 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c1bfab9e-9cb9-48cd-8902-60607d19404e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:16.119571 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-c1bfab9e-9cb9-48cd-8902-60607d19404e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] [instance: 650af48c-836d-4078-abb6-4b865a22a7d8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:16.125610 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c1bfab9e-9cb9-48cd-8902-60607d19404e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:16.126101 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c1bfab9e-9cb9-48cd-8902-60607d19404e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:16.126527 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c1bfab9e-9cb9-48cd-8902-60607d19404e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:16.127215 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c1bfab9e-9cb9-48cd-8902-60607d19404e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:16.127669 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c1bfab9e-9cb9-48cd-8902-60607d19404e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:16.128091 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c1bfab9e-9cb9-48cd-8902-60607d19404e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:16.141852 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-c1bfab9e-9cb9-48cd-8902-60607d19404e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] HTTP exception thrown: Instance 650af48c-836d-4078-abb6-4b865a22a7d8 could not be found. Aug 09 18:54:16.143479 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c1bfab9e-9cb9-48cd-8902-60607d19404e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Request method failure captured: Aug 09 18:54:16.143479 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: request: GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 HTTP/1.1 Aug 09 18:54:16.143479 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept: application/json Aug 09 18:54:16.143479 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Aug 09 18:54:16.143479 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Connection: close Aug 09 18:54:16.143479 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Length: 0 Aug 09 18:54:16.143479 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Type: application/json Aug 09 18:54:16.143479 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Host: 10.222.0.57 Aug 09 18:54:16.143479 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Aug 09 18:54:16.143479 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.11 Aug 09 18:54:16.143479 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABi8qwcYn_PR1bY-m21eiDaM-K65e27GCgB1hyw1OuGXRk37b51HFhla9CV-9Ypj2nAUtt--h-xdiAP9q3XcmfWWUfjCi-I0NaYuSy2aQQRGG3_zykXOBy5GJW4FO-NWWjB3ENfbKd8Tz-WldjUgCB_nawpLyJ7FUR9ShKkFO_khGgJwfI Aug 09 18:54:16.143479 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Aug 09 18:54:16.143479 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Aug 09 18:54:16.143479 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Aug 09 18:54:16.143479 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Aug 09 18:54:16.143479 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Aug 09 18:54:16.143479 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Aug 09 18:54:16.143479 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Id: d3c7915d78334e95a41a32f0f3b5b084 Aug 09 18:54:16.143479 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-687112300 Aug 09 18:54:16.143479 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Role: reader,member Aug 09 18:54:16.143479 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Roles: reader,member Aug 09 18:54:16.145055 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d3c7915d78334e95a41a32f0f3b5b084", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d3c7915d78334e95a41a32f0f3b5b084"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d3c7915d78334e95a41a32f0f3b5b084"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d3c7915d78334e95a41a32f0f3b5b084"}]}] Aug 09 18:54:16.145055 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-ServerRescueNegativeTestJSON-687112300 Aug 09 18:54:16.145055 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Id: d3c7915d78334e95a41a32f0f3b5b084 Aug 09 18:54:16.145055 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-687112300 Aug 09 18:54:16.145055 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User: tempest-ServerRescueNegativeTestJSON-687112300-project Aug 09 18:54:16.145055 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Aug 09 18:54:16.145055 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Aug 09 18:54:16.145055 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Id: 04da0f4276d6457c889ecb3006842e9c Aug 09 18:54:16.145055 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-ServerRescueNegativeTestJSON-687112300-project Aug 09 18:54:16.145055 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: method: > Aug 09 18:54:16.145055 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: exception: Instance 650af48c-836d-4078-abb6-4b865a22a7d8 could not be found. Aug 09 18:54:16.145055 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: action_args: {'id': '650af48c-836d-4078-abb6-4b865a22a7d8'} Aug 09 18:54:16.145939 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:54:16.145939 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:54:16.145939 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:54:16.145939 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:54:16.145939 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:54:16.145939 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:54:16.145939 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:54:16.145939 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:54:16.145939 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:54:16.145939 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:54:16.145939 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 650af48c-836d-4078-abb6-4b865a22a7d8 could not be found. Aug 09 18:54:16.145939 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:54:16.145939 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:54:16.145939 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:54:16.145939 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:54:16.145939 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:54:16.145939 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:54:16.145939 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:54:16.145939 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:54:16.145939 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:54:16.147360 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:54:16.147360 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:54:16.147360 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:54:16.147360 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:54:16.147360 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:54:16.147360 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:54:16.147360 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:54:16.147360 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 650af48c-836d-4078-abb6-4b865a22a7d8 could not be found. Aug 09 18:54:16.147360 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:54:16.147360 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:54:16.147360 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:54:16.147360 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:54:16.147360 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:54:16.147360 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:54:16.147360 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:54:16.147360 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:54:16.147360 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 650af48c-836d-4078-abb6-4b865a22a7d8 could not be found. Aug 09 18:54:16.147360 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:54:16.148641 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c1bfab9e-9cb9-48cd-8902-60607d19404e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] Returning 404 to user: Instance 650af48c-836d-4078-abb6-4b865a22a7d8 could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:54:16.148641 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-c1bfab9e-9cb9-48cd-8902-60607d19404e tempest-ServerRescueNegativeTestJSON-687112300 tempest-ServerRescueNegativeTestJSON-687112300-project] 10.222.0.57 "GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8" status: 404 len: 111 microversion: 2.1 time: 0.029963 Aug 09 18:54:16.148641 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 348/676] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:54:16 2022] GET /compute/v2.1/servers/650af48c-836d-4078-abb6-4b865a22a7d8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:54:16.838821 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-afa8783c-88c1-4313-93e2-79d9c00cd5ef tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:16.839916 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-afa8783c-88c1-4313-93e2-79d9c00cd5ef tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:16.846346 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-afa8783c-88c1-4313-93e2-79d9c00cd5ef tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:16.846824 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-afa8783c-88c1-4313-93e2-79d9c00cd5ef tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:16.847254 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-afa8783c-88c1-4313-93e2-79d9c00cd5ef tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:16.847944 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-afa8783c-88c1-4313-93e2-79d9c00cd5ef tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:16.848391 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-afa8783c-88c1-4313-93e2-79d9c00cd5ef tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:16.848809 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-afa8783c-88c1-4313-93e2-79d9c00cd5ef tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:16.978195 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-afa8783c-88c1-4313-93e2-79d9c00cd5ef tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:16.986953 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-afa8783c-88c1-4313-93e2-79d9c00cd5ef tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:16.988438 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-afa8783c-88c1-4313-93e2-79d9c00cd5ef tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:16.989617 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-afa8783c-88c1-4313-93e2-79d9c00cd5ef tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1723 microversion: 2.20 time: 0.154707 Aug 09 18:54:16.990190 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 329/677] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:54:16 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:54:18.012292 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-0d190b90-32f1-432e-a7ac-e4509f121b26 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:18.012938 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-0d190b90-32f1-432e-a7ac-e4509f121b26 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:18.019482 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0d190b90-32f1-432e-a7ac-e4509f121b26 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:18.021071 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0d190b90-32f1-432e-a7ac-e4509f121b26 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:18.021071 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0d190b90-32f1-432e-a7ac-e4509f121b26 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:18.021071 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0d190b90-32f1-432e-a7ac-e4509f121b26 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:18.021562 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0d190b90-32f1-432e-a7ac-e4509f121b26 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:18.021964 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0d190b90-32f1-432e-a7ac-e4509f121b26 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:18.255588 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-0d190b90-32f1-432e-a7ac-e4509f121b26 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:18.264516 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-0d190b90-32f1-432e-a7ac-e4509f121b26 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:18.268646 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-0d190b90-32f1-432e-a7ac-e4509f121b26 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:18.270109 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-0d190b90-32f1-432e-a7ac-e4509f121b26 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1723 microversion: 2.20 time: 0.261889 Aug 09 18:54:18.279294 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 349/678] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:54:18 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1723 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:54:19.292947 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-736f9f9f-e97f-4ddb-9781-9294c8589096 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:19.294177 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-736f9f9f-e97f-4ddb-9781-9294c8589096 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:19.301509 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-736f9f9f-e97f-4ddb-9781-9294c8589096 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:19.302048 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-736f9f9f-e97f-4ddb-9781-9294c8589096 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:19.302693 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-736f9f9f-e97f-4ddb-9781-9294c8589096 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:19.303392 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-736f9f9f-e97f-4ddb-9781-9294c8589096 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:19.303849 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-736f9f9f-e97f-4ddb-9781-9294c8589096 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:19.304277 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-736f9f9f-e97f-4ddb-9781-9294c8589096 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:19.511032 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-736f9f9f-e97f-4ddb-9781-9294c8589096 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:19.516143 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-736f9f9f-e97f-4ddb-9781-9294c8589096 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:19.517955 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-736f9f9f-e97f-4ddb-9781-9294c8589096 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:19.519353 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-736f9f9f-e97f-4ddb-9781-9294c8589096 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1723 microversion: 2.20 time: 0.230743 Aug 09 18:54:19.519995 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 330/679] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:54:19 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:54:20.541905 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-189ac3c6-9d2f-4896-8fad-29b510573f4a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:20.542516 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-189ac3c6-9d2f-4896-8fad-29b510573f4a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:20.549125 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-189ac3c6-9d2f-4896-8fad-29b510573f4a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:20.549639 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-189ac3c6-9d2f-4896-8fad-29b510573f4a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:20.550070 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-189ac3c6-9d2f-4896-8fad-29b510573f4a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:20.550897 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-189ac3c6-9d2f-4896-8fad-29b510573f4a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:20.551216 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-189ac3c6-9d2f-4896-8fad-29b510573f4a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:20.551635 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-189ac3c6-9d2f-4896-8fad-29b510573f4a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:20.711991 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-189ac3c6-9d2f-4896-8fad-29b510573f4a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:20.720701 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-189ac3c6-9d2f-4896-8fad-29b510573f4a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:20.722277 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-189ac3c6-9d2f-4896-8fad-29b510573f4a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:20.723377 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-189ac3c6-9d2f-4896-8fad-29b510573f4a tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1723 microversion: 2.20 time: 0.185319 Aug 09 18:54:20.724063 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 350/680] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:54:20 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:54:21.746391 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-d3166006-208e-4e6c-b012-3d5be933894c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:21.747125 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-d3166006-208e-4e6c-b012-3d5be933894c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:21.753741 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d3166006-208e-4e6c-b012-3d5be933894c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:21.754221 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d3166006-208e-4e6c-b012-3d5be933894c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:21.754650 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d3166006-208e-4e6c-b012-3d5be933894c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:21.755339 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d3166006-208e-4e6c-b012-3d5be933894c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:21.755794 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d3166006-208e-4e6c-b012-3d5be933894c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:21.756211 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d3166006-208e-4e6c-b012-3d5be933894c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:21.891935 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-d3166006-208e-4e6c-b012-3d5be933894c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:21.900656 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-d3166006-208e-4e6c-b012-3d5be933894c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:21.902711 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-d3166006-208e-4e6c-b012-3d5be933894c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:21.904421 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-d3166006-208e-4e6c-b012-3d5be933894c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1723 microversion: 2.20 time: 0.161977 Aug 09 18:54:21.905288 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 331/681] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:54:21 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:54:22.927081 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f214944c-1cac-4009-8661-677e4cb253dd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:22.927678 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-f214944c-1cac-4009-8661-677e4cb253dd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:22.934987 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f214944c-1cac-4009-8661-677e4cb253dd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:22.935456 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f214944c-1cac-4009-8661-677e4cb253dd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:22.935881 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f214944c-1cac-4009-8661-677e4cb253dd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:22.936563 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f214944c-1cac-4009-8661-677e4cb253dd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:22.937008 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f214944c-1cac-4009-8661-677e4cb253dd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:22.937424 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f214944c-1cac-4009-8661-677e4cb253dd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:23.077465 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f214944c-1cac-4009-8661-677e4cb253dd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:23.086319 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f214944c-1cac-4009-8661-677e4cb253dd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:23.087809 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f214944c-1cac-4009-8661-677e4cb253dd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:23.089659 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f214944c-1cac-4009-8661-677e4cb253dd tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1723 microversion: 2.20 time: 0.165753 Aug 09 18:54:23.090217 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 351/682] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:54:22 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:54:24.113364 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-eac97c90-fa8f-48df-a1d6-4e467cd7d9b4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:24.114027 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-eac97c90-fa8f-48df-a1d6-4e467cd7d9b4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:24.121188 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-eac97c90-fa8f-48df-a1d6-4e467cd7d9b4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:24.121700 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-eac97c90-fa8f-48df-a1d6-4e467cd7d9b4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:24.122194 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-eac97c90-fa8f-48df-a1d6-4e467cd7d9b4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:24.124769 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-eac97c90-fa8f-48df-a1d6-4e467cd7d9b4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:24.124769 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-eac97c90-fa8f-48df-a1d6-4e467cd7d9b4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:24.124769 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-eac97c90-fa8f-48df-a1d6-4e467cd7d9b4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:24.144640 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:54:24.271624 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-eac97c90-fa8f-48df-a1d6-4e467cd7d9b4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:24.280872 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-eac97c90-fa8f-48df-a1d6-4e467cd7d9b4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:24.282494 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-eac97c90-fa8f-48df-a1d6-4e467cd7d9b4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:24.283788 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-eac97c90-fa8f-48df-a1d6-4e467cd7d9b4 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1723 microversion: 2.20 time: 0.174346 Aug 09 18:54:24.284368 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 332/683] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:54:24 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:54:25.309289 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-0f544b02-3f60-4add-9fe5-d83de8bb6d31 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:25.309963 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-0f544b02-3f60-4add-9fe5-d83de8bb6d31 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:25.316436 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0f544b02-3f60-4add-9fe5-d83de8bb6d31 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:25.316919 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0f544b02-3f60-4add-9fe5-d83de8bb6d31 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:25.317354 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0f544b02-3f60-4add-9fe5-d83de8bb6d31 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:25.318205 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0f544b02-3f60-4add-9fe5-d83de8bb6d31 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:25.318657 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0f544b02-3f60-4add-9fe5-d83de8bb6d31 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:25.319081 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0f544b02-3f60-4add-9fe5-d83de8bb6d31 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:25.451885 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-0f544b02-3f60-4add-9fe5-d83de8bb6d31 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:25.459792 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-0f544b02-3f60-4add-9fe5-d83de8bb6d31 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:25.461318 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-0f544b02-3f60-4add-9fe5-d83de8bb6d31 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:25.462484 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-0f544b02-3f60-4add-9fe5-d83de8bb6d31 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1744 microversion: 2.20 time: 0.158110 Aug 09 18:54:25.463035 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 352/684] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:54:25 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:54:26.486113 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-4a38aaf0-6959-4130-b1db-ab6b039e1baf tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:26.486822 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-4a38aaf0-6959-4130-b1db-ab6b039e1baf tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:26.493228 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4a38aaf0-6959-4130-b1db-ab6b039e1baf tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:26.496661 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4a38aaf0-6959-4130-b1db-ab6b039e1baf tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:26.496661 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4a38aaf0-6959-4130-b1db-ab6b039e1baf tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:26.496661 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4a38aaf0-6959-4130-b1db-ab6b039e1baf tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:26.496661 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4a38aaf0-6959-4130-b1db-ab6b039e1baf tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:26.496975 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4a38aaf0-6959-4130-b1db-ab6b039e1baf tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:26.638588 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-4a38aaf0-6959-4130-b1db-ab6b039e1baf tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:26.649602 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-4a38aaf0-6959-4130-b1db-ab6b039e1baf tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:26.651281 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-4a38aaf0-6959-4130-b1db-ab6b039e1baf tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:26.652579 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-4a38aaf0-6959-4130-b1db-ab6b039e1baf tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1744 microversion: 2.20 time: 0.170587 Aug 09 18:54:26.653489 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 333/685] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:54:26 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1744 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:54:27.000010 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-81e5ff8c-9e83-40fa-88ce-46e98adc3803 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:27.000598 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-81e5ff8c-9e83-40fa-88ce-46e98adc3803 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 98218676-0e95-45b0-877f-4b0f7107048c] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:27.008141 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-81e5ff8c-9e83-40fa-88ce-46e98adc3803 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:27.013967 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-81e5ff8c-9e83-40fa-88ce-46e98adc3803 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:27.013967 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-81e5ff8c-9e83-40fa-88ce-46e98adc3803 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:27.013967 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-81e5ff8c-9e83-40fa-88ce-46e98adc3803 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:27.013967 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-81e5ff8c-9e83-40fa-88ce-46e98adc3803 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:27.015102 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-81e5ff8c-9e83-40fa-88ce-46e98adc3803 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:27.036540 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-81e5ff8c-9e83-40fa-88ce-46e98adc3803 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c/ips" status: 200 len: 150 microversion: 2.1 time: 0.040592 Aug 09 18:54:27.037343 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 353/686] 10.222.0.57 () {58 vars in 1248 bytes} [Tue Aug 9 18:54:26 2022] GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:54:27.678845 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-7813b718-85c3-4d63-b006-c01d7fcbdeba tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:27.679561 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-7813b718-85c3-4d63-b006-c01d7fcbdeba tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:27.686830 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7813b718-85c3-4d63-b006-c01d7fcbdeba tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:27.687324 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7813b718-85c3-4d63-b006-c01d7fcbdeba tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:27.687758 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7813b718-85c3-4d63-b006-c01d7fcbdeba tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:27.688494 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7813b718-85c3-4d63-b006-c01d7fcbdeba tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:27.688952 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7813b718-85c3-4d63-b006-c01d7fcbdeba tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:27.690067 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7813b718-85c3-4d63-b006-c01d7fcbdeba tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:27.856527 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-7813b718-85c3-4d63-b006-c01d7fcbdeba tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:27.865443 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-7813b718-85c3-4d63-b006-c01d7fcbdeba tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:27.867109 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-7813b718-85c3-4d63-b006-c01d7fcbdeba tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:27.868267 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-7813b718-85c3-4d63-b006-c01d7fcbdeba tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1739 microversion: 2.20 time: 0.195760 Aug 09 18:54:27.868822 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 334/687] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:54:27 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1739 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:54:28.688888 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-9e49596c-b254-409a-b1d4-cb846a033b07 req-6ad4a131-3cb7-4c67-9c89-79a5a07e3be2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f84c5e3-7213-4bd2-ad7c-4794aab9d631", "name": "network-vif-plugged", "status": "completed", "tag": "d2e3768b-d787-45b4-941d-9253bd20d687"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:54:28.701251 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-9e49596c-b254-409a-b1d4-cb846a033b07 req-6ad4a131-3cb7-4c67-9c89-79a5a07e3be2 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:28.702038 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-9e49596c-b254-409a-b1d4-cb846a033b07 req-6ad4a131-3cb7-4c67-9c89-79a5a07e3be2 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:28.706092 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-9e49596c-b254-409a-b1d4-cb846a033b07 req-6ad4a131-3cb7-4c67-9c89-79a5a07e3be2 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:28.715251 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-9e49596c-b254-409a-b1d4-cb846a033b07 req-6ad4a131-3cb7-4c67-9c89-79a5a07e3be2 service nova] Creating event network-vif-plugged:d2e3768b-d787-45b4-941d-9253bd20d687 for instance 8f84c5e3-7213-4bd2-ad7c-4794aab9d631 on hv-cinder-82660 Aug 09 18:54:28.720617 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-9e49596c-b254-409a-b1d4-cb846a033b07 req-6ad4a131-3cb7-4c67-9c89-79a5a07e3be2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035616 Aug 09 18:54:28.721482 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 354/688] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:54:28.896642 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-73417265-9de2-4cbc-aec2-758076c4a12b tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:28.897255 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-73417265-9de2-4cbc-aec2-758076c4a12b tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:28.903799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-8e446de4-df59-43d5-a87f-2b50a4cdccd7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55a49c3d-7652-4a6b-97ce-607e73a53bf5"}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:54:28.911533 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-8e446de4-df59-43d5-a87f-2b50a4cdccd7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 98218676-0e95-45b0-877f-4b0f7107048c] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:28.927979 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-73417265-9de2-4cbc-aec2-758076c4a12b tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:28.928488 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-73417265-9de2-4cbc-aec2-758076c4a12b tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:28.928962 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-73417265-9de2-4cbc-aec2-758076c4a12b tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:28.930697 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-73417265-9de2-4cbc-aec2-758076c4a12b tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:28.932733 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8e446de4-df59-43d5-a87f-2b50a4cdccd7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:28.933220 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8e446de4-df59-43d5-a87f-2b50a4cdccd7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:28.934075 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-73417265-9de2-4cbc-aec2-758076c4a12b tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:28.934504 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-73417265-9de2-4cbc-aec2-758076c4a12b tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:28.939158 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8e446de4-df59-43d5-a87f-2b50a4cdccd7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:28.940667 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8e446de4-df59-43d5-a87f-2b50a4cdccd7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:28.941100 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8e446de4-df59-43d5-a87f-2b50a4cdccd7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:28.941556 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8e446de4-df59-43d5-a87f-2b50a4cdccd7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:29.151282 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-73417265-9de2-4cbc-aec2-758076c4a12b tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:29.161562 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-73417265-9de2-4cbc-aec2-758076c4a12b tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:29.163109 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-73417265-9de2-4cbc-aec2-758076c4a12b tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:29.164306 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-73417265-9de2-4cbc-aec2-758076c4a12b tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1739 microversion: 2.20 time: 0.271700 Aug 09 18:54:29.184394 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 335/689] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:54:28 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1739 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:54:29.841725 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-2861fd93-fc36-407c-8f52-683c0cd87209 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:29.841725 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-2861fd93-fc36-407c-8f52-683c0cd87209 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ece2efc3-8ca5-4b96-93cb-42f4065610c6] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:29.849291 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2861fd93-fc36-407c-8f52-683c0cd87209 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:29.850068 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2861fd93-fc36-407c-8f52-683c0cd87209 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:29.850671 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2861fd93-fc36-407c-8f52-683c0cd87209 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:29.851408 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2861fd93-fc36-407c-8f52-683c0cd87209 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:29.852014 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2861fd93-fc36-407c-8f52-683c0cd87209 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:29.852661 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2861fd93-fc36-407c-8f52-683c0cd87209 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:29.878442 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-8e446de4-df59-43d5-a87f-2b50a4cdccd7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "POST /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.979066 Aug 09 18:54:29.879693 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 355/690] 10.222.0.57 () {60 vars in 1323 bytes} [Tue Aug 9 18:54:28 2022] POST /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c/os-volume_attachments => generated 194 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:54:29.891765 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-2861fd93-fc36-407c-8f52-683c0cd87209 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6/ips" status: 200 len: 146 microversion: 2.1 time: 0.323268 Aug 09 18:54:29.901459 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 336/691] 10.222.0.57 () {58 vars in 1248 bytes} [Tue Aug 9 18:54:29 2022] GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6/ips => generated 146 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:54:30.199205 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-63be140e-47c0-4426-ad85-28c05307eff1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:30.200729 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-63be140e-47c0-4426-ad85-28c05307eff1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:30.211633 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-63be140e-47c0-4426-ad85-28c05307eff1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:30.212638 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-63be140e-47c0-4426-ad85-28c05307eff1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:30.214099 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-63be140e-47c0-4426-ad85-28c05307eff1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:30.219900 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-63be140e-47c0-4426-ad85-28c05307eff1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:30.219900 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-63be140e-47c0-4426-ad85-28c05307eff1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:30.219900 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-63be140e-47c0-4426-ad85-28c05307eff1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:30.406806 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-63be140e-47c0-4426-ad85-28c05307eff1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:30.415839 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-63be140e-47c0-4426-ad85-28c05307eff1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:30.417704 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-63be140e-47c0-4426-ad85-28c05307eff1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:30.419599 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-63be140e-47c0-4426-ad85-28c05307eff1 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1739 microversion: 2.20 time: 0.227566 Aug 09 18:54:30.420152 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 356/692] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:54:30 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1739 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:54:31.444084 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-aaae9225-dce4-45ab-8f93-c97a311278d5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:31.445988 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-aaae9225-dce4-45ab-8f93-c97a311278d5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:31.454710 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-aaae9225-dce4-45ab-8f93-c97a311278d5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:31.455270 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-aaae9225-dce4-45ab-8f93-c97a311278d5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:31.455779 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-aaae9225-dce4-45ab-8f93-c97a311278d5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:31.456552 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-aaae9225-dce4-45ab-8f93-c97a311278d5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:31.457239 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-aaae9225-dce4-45ab-8f93-c97a311278d5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:31.457916 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-aaae9225-dce4-45ab-8f93-c97a311278d5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:31.618519 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-aaae9225-dce4-45ab-8f93-c97a311278d5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:31.631310 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-aaae9225-dce4-45ab-8f93-c97a311278d5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:31.637332 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-aaae9225-dce4-45ab-8f93-c97a311278d5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:31.637332 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-aaae9225-dce4-45ab-8f93-c97a311278d5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1739 microversion: 2.20 time: 0.194819 Aug 09 18:54:31.650235 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 337/693] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:54:31 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1739 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:54:31.927605 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-3249462e-5730-4665-a416-c1377a5cb2bb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e68e5f7-647d-4919-a4b0-fca78fd64db8"}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:54:31.930123 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-3249462e-5730-4665-a416-c1377a5cb2bb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ece2efc3-8ca5-4b96-93cb-42f4065610c6] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:31.937188 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3249462e-5730-4665-a416-c1377a5cb2bb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:31.937793 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3249462e-5730-4665-a416-c1377a5cb2bb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:31.938188 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3249462e-5730-4665-a416-c1377a5cb2bb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:31.938971 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3249462e-5730-4665-a416-c1377a5cb2bb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:31.939422 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3249462e-5730-4665-a416-c1377a5cb2bb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:31.939866 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3249462e-5730-4665-a416-c1377a5cb2bb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:32.659138 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-e35940c0-f106-4b27-8f77-fcab46d11d2f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:32.660105 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-e35940c0-f106-4b27-8f77-fcab46d11d2f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:32.667679 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e35940c0-f106-4b27-8f77-fcab46d11d2f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:32.668257 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e35940c0-f106-4b27-8f77-fcab46d11d2f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:32.668689 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e35940c0-f106-4b27-8f77-fcab46d11d2f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:32.669440 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e35940c0-f106-4b27-8f77-fcab46d11d2f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:32.670091 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e35940c0-f106-4b27-8f77-fcab46d11d2f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:32.670566 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e35940c0-f106-4b27-8f77-fcab46d11d2f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:32.863647 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-3249462e-5730-4665-a416-c1377a5cb2bb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "POST /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.941058 Aug 09 18:54:32.864249 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 357/694] 10.222.0.57 () {60 vars in 1323 bytes} [Tue Aug 9 18:54:31 2022] POST /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6/os-volume_attachments => generated 194 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:54:32.905574 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-e35940c0-f106-4b27-8f77-fcab46d11d2f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:32.920042 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-e35940c0-f106-4b27-8f77-fcab46d11d2f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:32.922250 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-e35940c0-f106-4b27-8f77-fcab46d11d2f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:32.923121 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-e35940c0-f106-4b27-8f77-fcab46d11d2f tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1739 microversion: 2.20 time: 0.267978 Aug 09 18:54:32.938314 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 338/695] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:54:32 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1739 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:54:33.969225 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b90871fa-0281-4097-a099-97ae0368bec5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:33.969225 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-b90871fa-0281-4097-a099-97ae0368bec5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:33.978266 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b90871fa-0281-4097-a099-97ae0368bec5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:33.980391 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b90871fa-0281-4097-a099-97ae0368bec5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:33.980391 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b90871fa-0281-4097-a099-97ae0368bec5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:33.980391 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b90871fa-0281-4097-a099-97ae0368bec5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:33.980391 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b90871fa-0281-4097-a099-97ae0368bec5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:33.980988 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b90871fa-0281-4097-a099-97ae0368bec5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:34.137570 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-b90871fa-0281-4097-a099-97ae0368bec5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:34.147491 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-b90871fa-0281-4097-a099-97ae0368bec5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:34.149175 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-b90871fa-0281-4097-a099-97ae0368bec5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:34.150578 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-b90871fa-0281-4097-a099-97ae0368bec5 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1739 microversion: 2.20 time: 0.190667 Aug 09 18:54:34.151447 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 358/696] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:54:33 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:54:35.180276 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-a573afec-2b64-46f3-b40a-3d4fd4e34fd9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:35.181062 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-a573afec-2b64-46f3-b40a-3d4fd4e34fd9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:35.188826 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a573afec-2b64-46f3-b40a-3d4fd4e34fd9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:35.189310 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a573afec-2b64-46f3-b40a-3d4fd4e34fd9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:35.189788 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a573afec-2b64-46f3-b40a-3d4fd4e34fd9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:35.190465 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a573afec-2b64-46f3-b40a-3d4fd4e34fd9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:35.190913 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a573afec-2b64-46f3-b40a-3d4fd4e34fd9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:35.191337 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a573afec-2b64-46f3-b40a-3d4fd4e34fd9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:35.334087 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-a573afec-2b64-46f3-b40a-3d4fd4e34fd9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:35.342194 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-a573afec-2b64-46f3-b40a-3d4fd4e34fd9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:35.343971 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-a573afec-2b64-46f3-b40a-3d4fd4e34fd9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:35.344825 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-a573afec-2b64-46f3-b40a-3d4fd4e34fd9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1739 microversion: 2.20 time: 0.169143 Aug 09 18:54:35.345382 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 339/697] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:54:35 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:54:36.368382 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f694b407-9ea3-4e8f-be68-0a4b73394b26 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:36.368889 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-f694b407-9ea3-4e8f-be68-0a4b73394b26 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:36.379606 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f694b407-9ea3-4e8f-be68-0a4b73394b26 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:36.380261 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f694b407-9ea3-4e8f-be68-0a4b73394b26 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:36.380872 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f694b407-9ea3-4e8f-be68-0a4b73394b26 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:36.381982 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f694b407-9ea3-4e8f-be68-0a4b73394b26 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:36.382753 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f694b407-9ea3-4e8f-be68-0a4b73394b26 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:36.383342 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f694b407-9ea3-4e8f-be68-0a4b73394b26 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:36.539603 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f694b407-9ea3-4e8f-be68-0a4b73394b26 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:36.550691 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f694b407-9ea3-4e8f-be68-0a4b73394b26 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:36.552275 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f694b407-9ea3-4e8f-be68-0a4b73394b26 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:36.553467 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f694b407-9ea3-4e8f-be68-0a4b73394b26 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1739 microversion: 2.20 time: 0.189290 Aug 09 18:54:36.557584 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 359/698] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:54:36 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:54:37.557897 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-b998f153-f8f2-4af5-8230-6e731a6941d1 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55a49c3d-7652-4a6b-97ce-607e73a53bf5"}} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:54:37.560840 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-b998f153-f8f2-4af5-8230-6e731a6941d1 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 98218676-0e95-45b0-877f-4b0f7107048c] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:37.570554 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b998f153-f8f2-4af5-8230-6e731a6941d1 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:37.571529 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b998f153-f8f2-4af5-8230-6e731a6941d1 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:37.576800 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-15985348-3df7-4481-955b-c1f2b9c9a9b6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:37.577948 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-15985348-3df7-4481-955b-c1f2b9c9a9b6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:37.583760 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b998f153-f8f2-4af5-8230-6e731a6941d1 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:37.584505 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b998f153-f8f2-4af5-8230-6e731a6941d1 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:37.584967 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b998f153-f8f2-4af5-8230-6e731a6941d1 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:37.585381 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b998f153-f8f2-4af5-8230-6e731a6941d1 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:37.587562 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-15985348-3df7-4481-955b-c1f2b9c9a9b6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:37.592816 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-15985348-3df7-4481-955b-c1f2b9c9a9b6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:37.593631 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-15985348-3df7-4481-955b-c1f2b9c9a9b6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:37.594613 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-15985348-3df7-4481-955b-c1f2b9c9a9b6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:37.595233 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-15985348-3df7-4481-955b-c1f2b9c9a9b6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:37.595821 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-15985348-3df7-4481-955b-c1f2b9c9a9b6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:37.821172 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-15985348-3df7-4481-955b-c1f2b9c9a9b6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:37.834050 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-15985348-3df7-4481-955b-c1f2b9c9a9b6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:37.836032 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-15985348-3df7-4481-955b-c1f2b9c9a9b6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:37.837466 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-15985348-3df7-4481-955b-c1f2b9c9a9b6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1739 microversion: 2.20 time: 0.264735 Aug 09 18:54:37.838489 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 360/699] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:54:37 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1739 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:54:37.979264 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.wsgi [None req-b998f153-f8f2-4af5-8230-6e731a6941d1 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] HTTP exception thrown: Invalid volume: volume 55a49c3d-7652-4a6b-97ce-607e73a53bf5 is already attached to instances: 98218676-0e95-45b0-877f-4b0f7107048c Aug 09 18:54:37.981475 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-b998f153-f8f2-4af5-8230-6e731a6941d1 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Request method failure captured: Aug 09 18:54:37.981475 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: request: POST /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c/os-volume_attachments HTTP/1.1 Aug 09 18:54:37.981475 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept: application/json Aug 09 18:54:37.981475 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept-Encoding: identity Aug 09 18:54:37.981475 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Connection: close Aug 09 18:54:37.981475 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Length: 74 Aug 09 18:54:37.981475 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Type: application/json Aug 09 18:54:37.981475 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Host: 10.222.0.57 Aug 09 18:54:37.981475 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Openstack-System-Scope: None Aug 09 18:54:37.981475 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: User-Agent: python-urllib3/1.26.11 Aug 09 18:54:37.981475 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Auth-Token: gAAAAABi8qxu6GlCXsghs7mXHsJ6lMdriR0lCN6zx0jJtIVa-hoSSpRyn9kABjaS5Ya_Ocw2sU0SEZSB-MC5jyn7nC01Qf-R3Wxc4u_OmCKdxSmXeuRuDoxnEqYVjV6mxSKvywrengnzW8AvtzIMJfiluX7W9B1UousoG9Ld7Q7tERFPOMWrYmI Aug 09 18:54:37.981475 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Id: None Aug 09 18:54:37.981475 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Name: None Aug 09 18:54:37.981475 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Identity-Status: Confirmed Aug 09 18:54:37.981475 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Is-Admin-Project: True Aug 09 18:54:37.981475 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Id: default Aug 09 18:54:37.981475 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Name: Default Aug 09 18:54:37.981475 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Id: 4a745db383cb452187f7c82b9977c09b Aug 09 18:54:37.981475 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Name: tempest-AttachVolumeNegativeTest-1856281892 Aug 09 18:54:37.981475 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Role: reader,member Aug 09 18:54:37.981475 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Roles: reader,member Aug 09 18:54:37.983127 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4a745db383cb452187f7c82b9977c09b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a745db383cb452187f7c82b9977c09b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4a745db383cb452187f7c82b9977c09b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a745db383cb452187f7c82b9977c09b"}]}] Aug 09 18:54:37.983127 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant: tempest-AttachVolumeNegativeTest-1856281892 Aug 09 18:54:37.983127 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Id: 4a745db383cb452187f7c82b9977c09b Aug 09 18:54:37.983127 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1856281892 Aug 09 18:54:37.983127 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User: tempest-AttachVolumeNegativeTest-1856281892-project Aug 09 18:54:37.983127 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Id: default Aug 09 18:54:37.983127 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Name: Default Aug 09 18:54:37.983127 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Id: 00491255f4b44125b6dc9f816c9bbb58 Aug 09 18:54:37.983127 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Name: tempest-AttachVolumeNegativeTest-1856281892-project Aug 09 18:54:37.983127 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Aug 09 18:54:37.983127 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: {"volumeAttachment": {"volumeId": "55a49c3d-7652-4a6b-97ce-607e73a53bf5"}} Aug 09 18:54:37.983127 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: method: > Aug 09 18:54:37.985201 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: exception: Invalid volume: volume 55a49c3d-7652-4a6b-97ce-607e73a53bf5 is already attached to instances: 98218676-0e95-45b0-877f-4b0f7107048c Aug 09 18:54:37.985201 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: action_args: {'server_id': '98218676-0e95-45b0-877f-4b0f7107048c', 'body': {'volumeAttachment': {'volumeId': '55a49c3d-7652-4a6b-97ce-607e73a53bf5'}}} Aug 09 18:54:37.985201 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:54:37.985201 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:54:37.985201 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 09 18:54:37.985201 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 09 18:54:37.985201 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 18:54:37.985201 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 18:54:37.985201 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 09 18:54:37.985201 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 18:54:37.985201 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 09 18:54:37.985201 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 09 18:54:37.985201 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 09 18:54:37.985201 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 09 18:54:37.985201 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 55a49c3d-7652-4a6b-97ce-607e73a53bf5 is already attached to instances: 98218676-0e95-45b0-877f-4b0f7107048c Aug 09 18:54:37.985201 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:54:37.985201 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:54:37.985201 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:54:37.985201 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:54:37.986630 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:54:37.986630 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:54:37.986630 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:54:37.986630 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:54:37.986630 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:54:37.986630 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:54:37.986630 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 18:54:37.986630 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 18:54:37.986630 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 18:54:37.986630 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 18:54:37.986630 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 18:54:37.986630 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 18:54:37.986630 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 09 18:54:37.986630 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 09 18:54:37.986630 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 55a49c3d-7652-4a6b-97ce-607e73a53bf5 is already attached to instances: 98218676-0e95-45b0-877f-4b0f7107048c Aug 09 18:54:37.986630 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:54:37.986630 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:54:37.986630 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:54:37.986630 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:54:37.986630 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:54:37.988050 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:54:37.988050 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:54:37.988050 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:54:37.988050 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 55a49c3d-7652-4a6b-97ce-607e73a53bf5 is already attached to instances: 98218676-0e95-45b0-877f-4b0f7107048c Aug 09 18:54:37.988050 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:54:37.988050 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-b998f153-f8f2-4af5-8230-6e731a6941d1 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Returning 400 to user: Invalid volume: volume 55a49c3d-7652-4a6b-97ce-607e73a53bf5 is already attached to instances: 98218676-0e95-45b0-877f-4b0f7107048c {{(pid=124726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:54:37.988050 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-b998f153-f8f2-4af5-8230-6e731a6941d1 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "POST /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.429396 Aug 09 18:54:37.988050 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 340/700] 10.222.0.57 () {60 vars in 1323 bytes} [Tue Aug 9 18:54:37 2022] POST /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c/os-volume_attachments => generated 174 bytes in 431 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 18:54:38.054668 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a91736aa-6412-4ac8-b432-de9078f9e604 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:38.055275 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-a91736aa-6412-4ac8-b432-de9078f9e604 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 98218676-0e95-45b0-877f-4b0f7107048c] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:38.062045 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a91736aa-6412-4ac8-b432-de9078f9e604 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:38.062620 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a91736aa-6412-4ac8-b432-de9078f9e604 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:38.063063 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a91736aa-6412-4ac8-b432-de9078f9e604 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:38.063775 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a91736aa-6412-4ac8-b432-de9078f9e604 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:38.064230 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a91736aa-6412-4ac8-b432-de9078f9e604 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:38.064661 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a91736aa-6412-4ac8-b432-de9078f9e604 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:38.069191 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:54:38.152400 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.objects.instance [None req-a91736aa-6412-4ac8-b432-de9078f9e604 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lazy-loading 'services' on Instance uuid 98218676-0e95-45b0-877f-4b0f7107048c {{(pid=124725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:54:38.836866 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-a91736aa-6412-4ac8-b432-de9078f9e604 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "DELETE /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c/os-volume_attachments/55a49c3d-7652-4a6b-97ce-607e73a53bf5" status: 202 len: 0 microversion: 2.1 time: 0.785897 Aug 09 18:54:38.838197 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 361/701] 10.222.0.57 () {58 vars in 1416 bytes} [Tue Aug 9 18:54:38 2022] DELETE /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c/os-volume_attachments/55a49c3d-7652-4a6b-97ce-607e73a53bf5 => generated 0 bytes in 788 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:54:38.848568 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-79ba85f3-764b-489e-8ef4-a1a3def30f69 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:38.851132 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-79ba85f3-764b-489e-8ef4-a1a3def30f69 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 98218676-0e95-45b0-877f-4b0f7107048c] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:38.865415 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-79ba85f3-764b-489e-8ef4-a1a3def30f69 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:38.866359 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-79ba85f3-764b-489e-8ef4-a1a3def30f69 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:38.867068 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-79ba85f3-764b-489e-8ef4-a1a3def30f69 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:38.867979 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-79ba85f3-764b-489e-8ef4-a1a3def30f69 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:38.868667 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-79ba85f3-764b-489e-8ef4-a1a3def30f69 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:38.869210 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-79ba85f3-764b-489e-8ef4-a1a3def30f69 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:38.870078 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f7324df1-df9d-4aca-ab1d-60f0144c1412 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:38.871190 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-f7324df1-df9d-4aca-ab1d-60f0144c1412 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:38.879077 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f7324df1-df9d-4aca-ab1d-60f0144c1412 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:38.879778 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f7324df1-df9d-4aca-ab1d-60f0144c1412 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:38.880399 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f7324df1-df9d-4aca-ab1d-60f0144c1412 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:38.881275 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f7324df1-df9d-4aca-ab1d-60f0144c1412 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:38.881915 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f7324df1-df9d-4aca-ab1d-60f0144c1412 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:38.882508 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f7324df1-df9d-4aca-ab1d-60f0144c1412 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:38.906636 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-79ba85f3-764b-489e-8ef4-a1a3def30f69 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063661 Aug 09 18:54:38.908087 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 341/702] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 9 18:54:38 2022] GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:54:39.039997 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f7324df1-df9d-4aca-ab1d-60f0144c1412 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:39.049896 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f7324df1-df9d-4aca-ab1d-60f0144c1412 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:39.053057 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f7324df1-df9d-4aca-ab1d-60f0144c1412 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:39.054380 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f7324df1-df9d-4aca-ab1d-60f0144c1412 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1739 microversion: 2.20 time: 0.192457 Aug 09 18:54:39.060542 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 362/703] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:54:38 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:54:39.920227 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-d0a6cd9c-aa08-4d86-a340-0e8385b12775 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:39.922487 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-d0a6cd9c-aa08-4d86-a340-0e8385b12775 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 98218676-0e95-45b0-877f-4b0f7107048c] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:39.929000 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d0a6cd9c-aa08-4d86-a340-0e8385b12775 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:39.929551 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d0a6cd9c-aa08-4d86-a340-0e8385b12775 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:39.929992 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d0a6cd9c-aa08-4d86-a340-0e8385b12775 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:39.930688 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d0a6cd9c-aa08-4d86-a340-0e8385b12775 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:39.931145 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d0a6cd9c-aa08-4d86-a340-0e8385b12775 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:39.931571 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d0a6cd9c-aa08-4d86-a340-0e8385b12775 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:39.959949 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-d0a6cd9c-aa08-4d86-a340-0e8385b12775 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044220 Aug 09 18:54:39.960504 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 342/704] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 9 18:54:39 2022] GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:54:40.081945 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d6914dc8-cf1d-4084-8525-7cd2abf7e708 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:40.082549 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-d6914dc8-cf1d-4084-8525-7cd2abf7e708 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:40.088943 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d6914dc8-cf1d-4084-8525-7cd2abf7e708 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:40.089421 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d6914dc8-cf1d-4084-8525-7cd2abf7e708 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:40.090499 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d6914dc8-cf1d-4084-8525-7cd2abf7e708 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:40.091242 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d6914dc8-cf1d-4084-8525-7cd2abf7e708 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:40.091691 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d6914dc8-cf1d-4084-8525-7cd2abf7e708 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:40.092112 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d6914dc8-cf1d-4084-8525-7cd2abf7e708 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:40.223528 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d6914dc8-cf1d-4084-8525-7cd2abf7e708 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:40.233342 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d6914dc8-cf1d-4084-8525-7cd2abf7e708 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:40.234957 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d6914dc8-cf1d-4084-8525-7cd2abf7e708 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:40.236113 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-d6914dc8-cf1d-4084-8525-7cd2abf7e708 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1739 microversion: 2.20 time: 0.158085 Aug 09 18:54:40.236675 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 363/705] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:54:40 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1739 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:54:40.972320 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-d32f2ce2-0149-437b-b738-66ef23c5fb75 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:40.974550 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-d32f2ce2-0149-437b-b738-66ef23c5fb75 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 98218676-0e95-45b0-877f-4b0f7107048c] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:40.976831 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:54:40.981686 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d32f2ce2-0149-437b-b738-66ef23c5fb75 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:40.982246 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d32f2ce2-0149-437b-b738-66ef23c5fb75 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:40.982613 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d32f2ce2-0149-437b-b738-66ef23c5fb75 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:40.986473 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d32f2ce2-0149-437b-b738-66ef23c5fb75 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:40.986473 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d32f2ce2-0149-437b-b738-66ef23c5fb75 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:40.986473 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d32f2ce2-0149-437b-b738-66ef23c5fb75 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:41.015095 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-d32f2ce2-0149-437b-b738-66ef23c5fb75 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046763 Aug 09 18:54:41.019187 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 343/706] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 9 18:54:40 2022] GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:54:41.259790 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-0d4081b2-00d9-4b15-8ca1-ff7366b3d30d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:41.260488 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-0d4081b2-00d9-4b15-8ca1-ff7366b3d30d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:41.268122 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0d4081b2-00d9-4b15-8ca1-ff7366b3d30d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:41.268606 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0d4081b2-00d9-4b15-8ca1-ff7366b3d30d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:41.269037 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0d4081b2-00d9-4b15-8ca1-ff7366b3d30d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:41.270148 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0d4081b2-00d9-4b15-8ca1-ff7366b3d30d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:41.270317 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0d4081b2-00d9-4b15-8ca1-ff7366b3d30d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:41.270743 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0d4081b2-00d9-4b15-8ca1-ff7366b3d30d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:41.405376 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-0d4081b2-00d9-4b15-8ca1-ff7366b3d30d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:41.413494 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-0d4081b2-00d9-4b15-8ca1-ff7366b3d30d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:41.415017 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-0d4081b2-00d9-4b15-8ca1-ff7366b3d30d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:41.416169 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-0d4081b2-00d9-4b15-8ca1-ff7366b3d30d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1721 microversion: 2.20 time: 0.160366 Aug 09 18:54:41.416739 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 364/707] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:54:41 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:54:42.028511 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-e35890df-ac62-48d3-8921-4f2a4ae1ba16 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:42.030791 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-e35890df-ac62-48d3-8921-4f2a4ae1ba16 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 98218676-0e95-45b0-877f-4b0f7107048c] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:42.037275 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e35890df-ac62-48d3-8921-4f2a4ae1ba16 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:42.037789 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e35890df-ac62-48d3-8921-4f2a4ae1ba16 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:42.038218 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e35890df-ac62-48d3-8921-4f2a4ae1ba16 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:42.038906 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e35890df-ac62-48d3-8921-4f2a4ae1ba16 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:42.039354 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e35890df-ac62-48d3-8921-4f2a4ae1ba16 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:42.039792 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e35890df-ac62-48d3-8921-4f2a4ae1ba16 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:42.068678 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-e35890df-ac62-48d3-8921-4f2a4ae1ba16 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044700 Aug 09 18:54:42.069234 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 344/708] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 9 18:54:42 2022] GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:54:42.439542 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-05066fdb-cdc8-4f54-acff-4953fbb24c71 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:42.440141 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-05066fdb-cdc8-4f54-acff-4953fbb24c71 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:42.443743 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=46 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:54:42.448913 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-05066fdb-cdc8-4f54-acff-4953fbb24c71 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:42.449395 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-05066fdb-cdc8-4f54-acff-4953fbb24c71 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:42.449868 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-05066fdb-cdc8-4f54-acff-4953fbb24c71 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:42.451253 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-05066fdb-cdc8-4f54-acff-4953fbb24c71 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:42.451253 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-05066fdb-cdc8-4f54-acff-4953fbb24c71 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:42.451623 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-05066fdb-cdc8-4f54-acff-4953fbb24c71 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:42.599107 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-05066fdb-cdc8-4f54-acff-4953fbb24c71 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:42.607449 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-05066fdb-cdc8-4f54-acff-4953fbb24c71 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:42.609630 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-05066fdb-cdc8-4f54-acff-4953fbb24c71 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:42.610708 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-05066fdb-cdc8-4f54-acff-4953fbb24c71 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1721 microversion: 2.20 time: 0.175506 Aug 09 18:54:42.611298 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 365/709] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:54:42 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:54:43.080866 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-b201bb28-7b23-47cc-bf73-679ba54dec76 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:43.083018 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-b201bb28-7b23-47cc-bf73-679ba54dec76 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 98218676-0e95-45b0-877f-4b0f7107048c] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:43.089473 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b201bb28-7b23-47cc-bf73-679ba54dec76 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:43.089983 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b201bb28-7b23-47cc-bf73-679ba54dec76 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:43.090417 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b201bb28-7b23-47cc-bf73-679ba54dec76 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:43.091104 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b201bb28-7b23-47cc-bf73-679ba54dec76 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:43.091559 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b201bb28-7b23-47cc-bf73-679ba54dec76 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:43.091974 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b201bb28-7b23-47cc-bf73-679ba54dec76 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:43.121636 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-b201bb28-7b23-47cc-bf73-679ba54dec76 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045150 Aug 09 18:54:43.122252 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 345/710] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 9 18:54:43 2022] GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:54:43.634432 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c1771878-7f9a-4569-81c8-ddce34076a59 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:43.635040 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-c1771878-7f9a-4569-81c8-ddce34076a59 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:43.641462 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c1771878-7f9a-4569-81c8-ddce34076a59 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:43.641978 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c1771878-7f9a-4569-81c8-ddce34076a59 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:43.643261 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c1771878-7f9a-4569-81c8-ddce34076a59 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:43.643261 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c1771878-7f9a-4569-81c8-ddce34076a59 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:43.643703 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c1771878-7f9a-4569-81c8-ddce34076a59 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:43.644126 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c1771878-7f9a-4569-81c8-ddce34076a59 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:43.785953 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-c1771878-7f9a-4569-81c8-ddce34076a59 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:43.794214 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-c1771878-7f9a-4569-81c8-ddce34076a59 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:43.795718 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-c1771878-7f9a-4569-81c8-ddce34076a59 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:43.796870 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-c1771878-7f9a-4569-81c8-ddce34076a59 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1724 microversion: 2.20 time: 0.166330 Aug 09 18:54:43.797437 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 366/711] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:54:43 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:54:43.819212 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-5587fb91-c186-46a4-9545-818db96ade03 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1565dd62-9ad8-4413-a71b-4e1b2e2dc3fb"}} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:54:43.821495 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-5587fb91-c186-46a4-9545-818db96ade03 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:43.827931 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5587fb91-c186-46a4-9545-818db96ade03 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:43.828397 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5587fb91-c186-46a4-9545-818db96ade03 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:43.828825 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5587fb91-c186-46a4-9545-818db96ade03 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:43.829498 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5587fb91-c186-46a4-9545-818db96ade03 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:43.829971 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5587fb91-c186-46a4-9545-818db96ade03 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:43.830416 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5587fb91-c186-46a4-9545-818db96ade03 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:44.133320 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e8acdb2c-795b-4d2c-bbe5-bf973e4b5fc4 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:44.135534 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e8acdb2c-795b-4d2c-bbe5-bf973e4b5fc4 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 98218676-0e95-45b0-877f-4b0f7107048c] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:44.142099 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e8acdb2c-795b-4d2c-bbe5-bf973e4b5fc4 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:44.142587 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e8acdb2c-795b-4d2c-bbe5-bf973e4b5fc4 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:44.143029 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e8acdb2c-795b-4d2c-bbe5-bf973e4b5fc4 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:44.143784 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e8acdb2c-795b-4d2c-bbe5-bf973e4b5fc4 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:44.144247 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e8acdb2c-795b-4d2c-bbe5-bf973e4b5fc4 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:44.144673 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e8acdb2c-795b-4d2c-bbe5-bf973e4b5fc4 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:44.172877 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e8acdb2c-795b-4d2c-bbe5-bf973e4b5fc4 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043608 Aug 09 18:54:44.173440 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 367/712] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 9 18:54:44 2022] GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:54:44.794512 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-64a1bdad-b481-4bf6-9266-a124210b4a3f req-2f8da381-2aba-4a5b-abf3-5d8770ebbc18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f84c5e3-7213-4bd2-ad7c-4794aab9d631", "name": "network-vif-unplugged", "status": "completed", "tag": "d2e3768b-d787-45b4-941d-9253bd20d687"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:54:44.804704 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-64a1bdad-b481-4bf6-9266-a124210b4a3f req-2f8da381-2aba-4a5b-abf3-5d8770ebbc18 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:44.805161 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-64a1bdad-b481-4bf6-9266-a124210b4a3f req-2f8da381-2aba-4a5b-abf3-5d8770ebbc18 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:44.805691 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-64a1bdad-b481-4bf6-9266-a124210b4a3f req-2f8da381-2aba-4a5b-abf3-5d8770ebbc18 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:44.817063 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.compute.server_external_events [req-64a1bdad-b481-4bf6-9266-a124210b4a3f req-2f8da381-2aba-4a5b-abf3-5d8770ebbc18 service nova] Unable to find a host for instance 8f84c5e3-7213-4bd2-ad7c-4794aab9d631. Dropping event network-vif-unplugged {{(pid=124725) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 09 18:54:44.817962 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-64a1bdad-b481-4bf6-9266-a124210b4a3f req-2f8da381-2aba-4a5b-abf3-5d8770ebbc18 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.091107 Aug 09 18:54:44.818536 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 368/713] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 92 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 09 18:54:44.823242 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-2707fea7-3238-49ad-8104-2a04ce88a9b8 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:44.825392 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-2707fea7-3238-49ad-8104-2a04ce88a9b8 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ece2efc3-8ca5-4b96-93cb-42f4065610c6] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:44.831285 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2707fea7-3238-49ad-8104-2a04ce88a9b8 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:44.832674 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2707fea7-3238-49ad-8104-2a04ce88a9b8 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:44.832674 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2707fea7-3238-49ad-8104-2a04ce88a9b8 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:44.832881 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2707fea7-3238-49ad-8104-2a04ce88a9b8 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:44.833321 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2707fea7-3238-49ad-8104-2a04ce88a9b8 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:44.833787 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2707fea7-3238-49ad-8104-2a04ce88a9b8 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:44.863964 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-2707fea7-3238-49ad-8104-2a04ce88a9b8 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044373 Aug 09 18:54:44.864501 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 369/714] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 9 18:54:44 2022] GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:54:44.874984 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-0a60b217-5534-4acd-a382-051a164827ca tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:44.875511 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-0a60b217-5534-4acd-a382-051a164827ca tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ece2efc3-8ca5-4b96-93cb-42f4065610c6] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:44.881484 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0a60b217-5534-4acd-a382-051a164827ca tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:44.881995 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0a60b217-5534-4acd-a382-051a164827ca tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:44.882453 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0a60b217-5534-4acd-a382-051a164827ca tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:44.883149 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0a60b217-5534-4acd-a382-051a164827ca tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:44.883599 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0a60b217-5534-4acd-a382-051a164827ca tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:44.884020 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0a60b217-5534-4acd-a382-051a164827ca tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:44.911695 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:54:44.914653 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-0a60b217-5534-4acd-a382-051a164827ca tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6/os-volume_attachments/6e68e5f7-647d-4919-a4b0-fca78fd64db8" status: 200 len: 194 microversion: 2.1 time: 0.043416 Aug 09 18:54:44.915261 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 370/715] 10.222.0.57 () {58 vars in 1413 bytes} [Tue Aug 9 18:54:44 2022] GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6/os-volume_attachments/6e68e5f7-647d-4919-a4b0-fca78fd64db8 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:54:44.979492 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-5587fb91-c186-46a4-9545-818db96ade03 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "POST /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.164282 Aug 09 18:54:44.980324 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 346/716] 10.222.0.57 () {62 vars in 1364 bytes} [Tue Aug 9 18:54:43 2022] POST /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631/os-volume_attachments => generated 188 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:54:45.106823 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-3a728457-90ca-47bd-8367-98b95ce21692 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:45.107324 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-3a728457-90ca-47bd-8367-98b95ce21692 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:45.114037 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3a728457-90ca-47bd-8367-98b95ce21692 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:45.114946 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3a728457-90ca-47bd-8367-98b95ce21692 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:45.115490 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3a728457-90ca-47bd-8367-98b95ce21692 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:45.116280 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3a728457-90ca-47bd-8367-98b95ce21692 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:45.116815 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3a728457-90ca-47bd-8367-98b95ce21692 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:45.117304 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3a728457-90ca-47bd-8367-98b95ce21692 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:45.185466 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-428001c2-13fa-429c-ae1c-06688d61bd4e tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:45.187664 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-428001c2-13fa-429c-ae1c-06688d61bd4e tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 98218676-0e95-45b0-877f-4b0f7107048c] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:45.194960 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-428001c2-13fa-429c-ae1c-06688d61bd4e tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:45.195443 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-428001c2-13fa-429c-ae1c-06688d61bd4e tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:45.195877 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-428001c2-13fa-429c-ae1c-06688d61bd4e tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:45.196566 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-428001c2-13fa-429c-ae1c-06688d61bd4e tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:45.197015 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-428001c2-13fa-429c-ae1c-06688d61bd4e tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:45.197434 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-428001c2-13fa-429c-ae1c-06688d61bd4e tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:45.227483 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-428001c2-13fa-429c-ae1c-06688d61bd4e tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046279 Aug 09 18:54:45.228048 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 347/717] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 9 18:54:45 2022] GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:54:46.034150 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-3a728457-90ca-47bd-8367-98b95ce21692 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631/os-volume_attachments/1565dd62-9ad8-4413-a71b-4e1b2e2dc3fb" status: 202 len: 0 microversion: 2.20 time: 0.931174 Aug 09 18:54:46.034781 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 371/718] 10.222.0.57 () {60 vars in 1457 bytes} [Tue Aug 9 18:54:45 2022] DELETE /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631/os-volume_attachments/1565dd62-9ad8-4413-a71b-4e1b2e2dc3fb => generated 0 bytes in 932 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:54:46.096773 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-67fdbc8b-59ac-42ec-a605-6b7f2a7d72a2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:54:46.097373 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-67fdbc8b-59ac-42ec-a605-6b7f2a7d72a2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:46.103816 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-67fdbc8b-59ac-42ec-a605-6b7f2a7d72a2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:46.104302 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-67fdbc8b-59ac-42ec-a605-6b7f2a7d72a2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:46.104742 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-67fdbc8b-59ac-42ec-a605-6b7f2a7d72a2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:46.105428 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-67fdbc8b-59ac-42ec-a605-6b7f2a7d72a2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:46.105908 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-67fdbc8b-59ac-42ec-a605-6b7f2a7d72a2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:46.106334 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-67fdbc8b-59ac-42ec-a605-6b7f2a7d72a2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:46.240457 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e57cd4af-3d12-4e5c-983c-695ab7327e12 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:46.242647 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e57cd4af-3d12-4e5c-983c-695ab7327e12 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 98218676-0e95-45b0-877f-4b0f7107048c] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:46.246406 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-67fdbc8b-59ac-42ec-a605-6b7f2a7d72a2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124726) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 09 18:54:46.250147 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e57cd4af-3d12-4e5c-983c-695ab7327e12 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:46.250882 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e57cd4af-3d12-4e5c-983c-695ab7327e12 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:46.251462 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e57cd4af-3d12-4e5c-983c-695ab7327e12 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:46.252323 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e57cd4af-3d12-4e5c-983c-695ab7327e12 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:46.253081 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e57cd4af-3d12-4e5c-983c-695ab7327e12 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:46.253673 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e57cd4af-3d12-4e5c-983c-695ab7327e12 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:46.446197 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e57cd4af-3d12-4e5c-983c-695ab7327e12 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049721 Aug 09 18:54:46.446197 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 372/719] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 9 18:54:46 2022] GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 18:54:46.446197 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d89ead4b-a7a3-4c65-b4b2-aae12ad3fc85 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:46.446197 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-d89ead4b-a7a3-4c65-b4b2-aae12ad3fc85 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 98218676-0e95-45b0-877f-4b0f7107048c] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:46.446197 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d89ead4b-a7a3-4c65-b4b2-aae12ad3fc85 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:46.447054 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d89ead4b-a7a3-4c65-b4b2-aae12ad3fc85 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:46.447054 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d89ead4b-a7a3-4c65-b4b2-aae12ad3fc85 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:46.447054 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d89ead4b-a7a3-4c65-b4b2-aae12ad3fc85 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:46.447054 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d89ead4b-a7a3-4c65-b4b2-aae12ad3fc85 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:46.447666 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d89ead4b-a7a3-4c65-b4b2-aae12ad3fc85 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:46.447666 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-d89ead4b-a7a3-4c65-b4b2-aae12ad3fc85 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 98218676-0e95-45b0-877f-4b0f7107048c] Going to try to terminate instance {{(pid=124725) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:54:46.515320 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:54:46.679358 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-67fdbc8b-59ac-42ec-a605-6b7f2a7d72a2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "POST /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631/action" status: 202 len: 0 microversion: 2.20 time: 0.586823 Aug 09 18:54:46.679976 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 348/720] 10.222.0.57 () {62 vars in 1319 bytes} [Tue Aug 9 18:54:46 2022] POST /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631/action => generated 0 bytes in 588 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 09 18:54:46.688358 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-4e95f2c4-9e0e-4db6-96cb-793007699608 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0b40c26e-b489-4b00-8b07-669b9d569f3f"}} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:54:46.690860 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-4e95f2c4-9e0e-4db6-96cb-793007699608 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ece2efc3-8ca5-4b96-93cb-42f4065610c6] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:46.698111 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-d89ead4b-a7a3-4c65-b4b2-aae12ad3fc85 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "DELETE /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c" status: 204 len: 0 microversion: 2.1 time: 0.336078 Aug 09 18:54:46.698707 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 373/721] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 9 18:54:46 2022] DELETE /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 18:54:46.701430 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4e95f2c4-9e0e-4db6-96cb-793007699608 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:46.704778 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4e95f2c4-9e0e-4db6-96cb-793007699608 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:46.704778 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4e95f2c4-9e0e-4db6-96cb-793007699608 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:46.704778 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4e95f2c4-9e0e-4db6-96cb-793007699608 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:46.704778 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4e95f2c4-9e0e-4db6-96cb-793007699608 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:46.705121 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5d59f5e7-713e-457b-b800-b89252cc3506 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:46.705228 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4e95f2c4-9e0e-4db6-96cb-793007699608 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:46.705325 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-5d59f5e7-713e-457b-b800-b89252cc3506 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:46.713072 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5d59f5e7-713e-457b-b800-b89252cc3506 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:46.713590 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5d59f5e7-713e-457b-b800-b89252cc3506 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:46.714143 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5d59f5e7-713e-457b-b800-b89252cc3506 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:46.714854 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5d59f5e7-713e-457b-b800-b89252cc3506 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:46.715311 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5d59f5e7-713e-457b-b800-b89252cc3506 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:46.715736 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5d59f5e7-713e-457b-b800-b89252cc3506 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:46.867106 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5d59f5e7-713e-457b-b800-b89252cc3506 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:46.875542 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5d59f5e7-713e-457b-b800-b89252cc3506 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:46.877048 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5d59f5e7-713e-457b-b800-b89252cc3506 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:46.878233 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-5d59f5e7-713e-457b-b800-b89252cc3506 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1672 microversion: 2.20 time: 0.178379 Aug 09 18:54:46.878789 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 374/722] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:54:46 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1672 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:54:46.893326 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-fbdc7eed-912a-434b-a73a-51b64aeff69d tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:46.893326 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-fbdc7eed-912a-434b-a73a-51b64aeff69d tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 98218676-0e95-45b0-877f-4b0f7107048c] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:46.893326 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fbdc7eed-912a-434b-a73a-51b64aeff69d tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:46.893326 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fbdc7eed-912a-434b-a73a-51b64aeff69d tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:46.893778 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fbdc7eed-912a-434b-a73a-51b64aeff69d tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:46.893778 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fbdc7eed-912a-434b-a73a-51b64aeff69d tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:46.893778 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fbdc7eed-912a-434b-a73a-51b64aeff69d tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:46.893778 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fbdc7eed-912a-434b-a73a-51b64aeff69d tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:47.031236 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-fbdc7eed-912a-434b-a73a-51b64aeff69d tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:47.038785 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-fbdc7eed-912a-434b-a73a-51b64aeff69d tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c" status: 200 len: 1682 microversion: 2.1 time: 0.159036 Aug 09 18:54:47.046239 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 375/723] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:54:46 2022] GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:54:47.899989 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-162676c7-d131-46af-93bb-80c63e5234c2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:47.900594 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-162676c7-d131-46af-93bb-80c63e5234c2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:47.908143 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-162676c7-d131-46af-93bb-80c63e5234c2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:47.909020 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-162676c7-d131-46af-93bb-80c63e5234c2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:47.909916 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-162676c7-d131-46af-93bb-80c63e5234c2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:47.911078 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-162676c7-d131-46af-93bb-80c63e5234c2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:47.911644 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-162676c7-d131-46af-93bb-80c63e5234c2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:47.912449 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-162676c7-d131-46af-93bb-80c63e5234c2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:48.146336 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-162676c7-d131-46af-93bb-80c63e5234c2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:48.155296 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-162676c7-d131-46af-93bb-80c63e5234c2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:48.159046 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-162676c7-d131-46af-93bb-80c63e5234c2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:48.159046 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-162676c7-d131-46af-93bb-80c63e5234c2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1672 microversion: 2.20 time: 0.261872 Aug 09 18:54:48.159046 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 376/724] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:54:47 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1672 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:54:48.163270 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-0d415631-8936-4e2d-90ee-f501b1468ac5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:48.163856 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-0d415631-8936-4e2d-90ee-f501b1468ac5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 98218676-0e95-45b0-877f-4b0f7107048c] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:48.169596 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0d415631-8936-4e2d-90ee-f501b1468ac5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:48.170081 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0d415631-8936-4e2d-90ee-f501b1468ac5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:48.170513 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0d415631-8936-4e2d-90ee-f501b1468ac5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:48.171797 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0d415631-8936-4e2d-90ee-f501b1468ac5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:48.172253 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0d415631-8936-4e2d-90ee-f501b1468ac5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:48.172677 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0d415631-8936-4e2d-90ee-f501b1468ac5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:48.314014 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-0d415631-8936-4e2d-90ee-f501b1468ac5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:48.322112 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-0d415631-8936-4e2d-90ee-f501b1468ac5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c" status: 200 len: 1682 microversion: 2.1 time: 0.162268 Aug 09 18:54:48.322806 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 377/725] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:54:48 2022] GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:54:48.846315 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-4e95f2c4-9e0e-4db6-96cb-793007699608 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "POST /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.161519 Aug 09 18:54:48.848615 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 349/726] 10.222.0.57 () {60 vars in 1323 bytes} [Tue Aug 9 18:54:46 2022] POST /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6/os-volume_attachments => generated 194 bytes in 2166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:54:49.185234 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-1e321221-898a-4561-999d-cd5ac8011912 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:49.186201 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-1e321221-898a-4561-999d-cd5ac8011912 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:49.192823 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1e321221-898a-4561-999d-cd5ac8011912 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:49.193299 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1e321221-898a-4561-999d-cd5ac8011912 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:49.193962 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1e321221-898a-4561-999d-cd5ac8011912 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:49.199254 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1e321221-898a-4561-999d-cd5ac8011912 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:49.199254 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1e321221-898a-4561-999d-cd5ac8011912 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:49.199254 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1e321221-898a-4561-999d-cd5ac8011912 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:49.345419 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-4ea47d98-6520-4685-a653-beaf97a83a27 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:49.346331 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-4ea47d98-6520-4685-a653-beaf97a83a27 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 98218676-0e95-45b0-877f-4b0f7107048c] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:49.355706 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4ea47d98-6520-4685-a653-beaf97a83a27 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:49.356340 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4ea47d98-6520-4685-a653-beaf97a83a27 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:49.357636 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4ea47d98-6520-4685-a653-beaf97a83a27 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:49.358965 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4ea47d98-6520-4685-a653-beaf97a83a27 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:49.359541 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4ea47d98-6520-4685-a653-beaf97a83a27 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:49.360884 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4ea47d98-6520-4685-a653-beaf97a83a27 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:49.408976 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1e321221-898a-4561-999d-cd5ac8011912 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:49.418583 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1e321221-898a-4561-999d-cd5ac8011912 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:49.430847 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1e321221-898a-4561-999d-cd5ac8011912 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:49.430847 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-1e321221-898a-4561-999d-cd5ac8011912 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1730 microversion: 2.20 time: 0.242969 Aug 09 18:54:49.430847 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 378/727] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:54:49 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1730 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:54:49.486553 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-4ea47d98-6520-4685-a653-beaf97a83a27 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:49.500382 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-4ea47d98-6520-4685-a653-beaf97a83a27 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c" status: 200 len: 1614 microversion: 2.1 time: 0.159450 Aug 09 18:54:49.507524 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 350/728] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:54:49 2022] GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c => generated 1614 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:54:49.919860 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-fcd48bd8-eedb-4cf9-8482-db752db59e73 req-6279241b-4fb3-4481-a1e4-bc0b16949645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98218676-0e95-45b0-877f-4b0f7107048c", "name": "network-vif-deleted", "tag": "0bb8e403-067a-402f-a488-981ea17677b8"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:54:49.931843 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-fcd48bd8-eedb-4cf9-8482-db752db59e73 req-6279241b-4fb3-4481-a1e4-bc0b16949645 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:49.937238 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-fcd48bd8-eedb-4cf9-8482-db752db59e73 req-6279241b-4fb3-4481-a1e4-bc0b16949645 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:49.937238 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-fcd48bd8-eedb-4cf9-8482-db752db59e73 req-6279241b-4fb3-4481-a1e4-bc0b16949645 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:49.947829 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-fcd48bd8-eedb-4cf9-8482-db752db59e73 req-6279241b-4fb3-4481-a1e4-bc0b16949645 service nova] Creating event network-vif-deleted:0bb8e403-067a-402f-a488-981ea17677b8 for instance 98218676-0e95-45b0-877f-4b0f7107048c on hv-cinder-82660 Aug 09 18:54:49.958701 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-fcd48bd8-eedb-4cf9-8482-db752db59e73 req-6279241b-4fb3-4481-a1e4-bc0b16949645 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113491 Aug 09 18:54:49.964088 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 379/729] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:54:50.446445 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-ad298895-ccf7-48b2-88c6-d27a1dad5d50 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:50.447054 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-ad298895-ccf7-48b2-88c6-d27a1dad5d50 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:50.454065 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ad298895-ccf7-48b2-88c6-d27a1dad5d50 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:50.454553 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ad298895-ccf7-48b2-88c6-d27a1dad5d50 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:50.454983 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ad298895-ccf7-48b2-88c6-d27a1dad5d50 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:50.455909 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ad298895-ccf7-48b2-88c6-d27a1dad5d50 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:50.456357 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ad298895-ccf7-48b2-88c6-d27a1dad5d50 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:50.456777 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ad298895-ccf7-48b2-88c6-d27a1dad5d50 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:50.522132 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-8bd24525-4c48-420b-a3c2-db5d79d8cef5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:50.522992 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-8bd24525-4c48-420b-a3c2-db5d79d8cef5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 98218676-0e95-45b0-877f-4b0f7107048c] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:50.529233 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8bd24525-4c48-420b-a3c2-db5d79d8cef5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:50.529749 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8bd24525-4c48-420b-a3c2-db5d79d8cef5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:50.530272 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8bd24525-4c48-420b-a3c2-db5d79d8cef5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:50.530969 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8bd24525-4c48-420b-a3c2-db5d79d8cef5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:50.531778 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8bd24525-4c48-420b-a3c2-db5d79d8cef5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:50.531923 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8bd24525-4c48-420b-a3c2-db5d79d8cef5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:50.576323 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8bd24525-4c48-420b-a3c2-db5d79d8cef5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:50.578705 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8bd24525-4c48-420b-a3c2-db5d79d8cef5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:50.578705 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8bd24525-4c48-420b-a3c2-db5d79d8cef5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:50.579852 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.objects.instance [None req-8bd24525-4c48-420b-a3c2-db5d79d8cef5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lazy-loading 'fault' on Instance uuid 98218676-0e95-45b0-877f-4b0f7107048c {{(pid=124725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:54:50.663478 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-8bd24525-4c48-420b-a3c2-db5d79d8cef5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:50.674665 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-8bd24525-4c48-420b-a3c2-db5d79d8cef5 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c" status: 200 len: 1331 microversion: 2.1 time: 0.157100 Aug 09 18:54:50.676527 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-ad298895-ccf7-48b2-88c6-d27a1dad5d50 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:50.676677 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 380/730] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:54:50 2022] GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c => generated 1331 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:54:50.703439 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-ad298895-ccf7-48b2-88c6-d27a1dad5d50 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:50.705804 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-ad298895-ccf7-48b2-88c6-d27a1dad5d50 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:50.706944 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-ad298895-ccf7-48b2-88c6-d27a1dad5d50 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1730 microversion: 2.20 time: 0.264866 Aug 09 18:54:50.713731 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 351/731] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:54:50 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1730 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:54:51.701766 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f6768879-5dbb-4aa9-96c9-d8d92e0f9fa0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:51.704345 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-f6768879-5dbb-4aa9-96c9-d8d92e0f9fa0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 98218676-0e95-45b0-877f-4b0f7107048c] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:51.717953 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f6768879-5dbb-4aa9-96c9-d8d92e0f9fa0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:51.718740 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f6768879-5dbb-4aa9-96c9-d8d92e0f9fa0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:51.719505 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f6768879-5dbb-4aa9-96c9-d8d92e0f9fa0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:51.720439 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f6768879-5dbb-4aa9-96c9-d8d92e0f9fa0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:51.723517 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f6768879-5dbb-4aa9-96c9-d8d92e0f9fa0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:51.724989 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f6768879-5dbb-4aa9-96c9-d8d92e0f9fa0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:51.733274 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-e8ddc900-711e-42a4-8f75-6f9f8edb70a6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:51.734222 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-e8ddc900-711e-42a4-8f75-6f9f8edb70a6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:51.742813 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e8ddc900-711e-42a4-8f75-6f9f8edb70a6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:51.743404 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e8ddc900-711e-42a4-8f75-6f9f8edb70a6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:51.744024 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e8ddc900-711e-42a4-8f75-6f9f8edb70a6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:51.744972 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e8ddc900-711e-42a4-8f75-6f9f8edb70a6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:51.745576 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e8ddc900-711e-42a4-8f75-6f9f8edb70a6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:51.746334 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e8ddc900-711e-42a4-8f75-6f9f8edb70a6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:51.748552 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-f6768879-5dbb-4aa9-96c9-d8d92e0f9fa0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] HTTP exception thrown: Instance 98218676-0e95-45b0-877f-4b0f7107048c could not be found. Aug 09 18:54:51.751592 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f6768879-5dbb-4aa9-96c9-d8d92e0f9fa0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Request method failure captured: Aug 09 18:54:51.751592 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: request: GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c HTTP/1.1 Aug 09 18:54:51.751592 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept: application/json Aug 09 18:54:51.751592 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Aug 09 18:54:51.751592 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Connection: close Aug 09 18:54:51.751592 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Length: 0 Aug 09 18:54:51.751592 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Type: application/json Aug 09 18:54:51.751592 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Host: 10.222.0.57 Aug 09 18:54:51.751592 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Aug 09 18:54:51.751592 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.11 Aug 09 18:54:51.751592 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABi8qxu6GlCXsghs7mXHsJ6lMdriR0lCN6zx0jJtIVa-hoSSpRyn9kABjaS5Ya_Ocw2sU0SEZSB-MC5jyn7nC01Qf-R3Wxc4u_OmCKdxSmXeuRuDoxnEqYVjV6mxSKvywrengnzW8AvtzIMJfiluX7W9B1UousoG9Ld7Q7tERFPOMWrYmI Aug 09 18:54:51.751592 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Aug 09 18:54:51.751592 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Aug 09 18:54:51.751592 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Aug 09 18:54:51.751592 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Aug 09 18:54:51.751592 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Aug 09 18:54:51.751592 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Aug 09 18:54:51.751592 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Id: 4a745db383cb452187f7c82b9977c09b Aug 09 18:54:51.751592 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-AttachVolumeNegativeTest-1856281892 Aug 09 18:54:51.751592 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Role: reader,member Aug 09 18:54:51.751592 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Roles: reader,member Aug 09 18:54:51.754931 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4a745db383cb452187f7c82b9977c09b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a745db383cb452187f7c82b9977c09b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4a745db383cb452187f7c82b9977c09b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a745db383cb452187f7c82b9977c09b"}]}] Aug 09 18:54:51.754931 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-AttachVolumeNegativeTest-1856281892 Aug 09 18:54:51.754931 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 4a745db383cb452187f7c82b9977c09b Aug 09 18:54:51.754931 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1856281892 Aug 09 18:54:51.754931 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User: tempest-AttachVolumeNegativeTest-1856281892-project Aug 09 18:54:51.754931 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Aug 09 18:54:51.754931 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Aug 09 18:54:51.754931 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Id: 00491255f4b44125b6dc9f816c9bbb58 Aug 09 18:54:51.754931 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-AttachVolumeNegativeTest-1856281892-project Aug 09 18:54:51.754931 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: method: > Aug 09 18:54:51.754931 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: exception: Instance 98218676-0e95-45b0-877f-4b0f7107048c could not be found. Aug 09 18:54:51.754931 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: action_args: {'id': '98218676-0e95-45b0-877f-4b0f7107048c'} Aug 09 18:54:51.755689 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:54:51.755689 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:54:51.755689 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:54:51.755689 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:54:51.755689 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:54:51.755689 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:54:51.755689 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:54:51.755689 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:54:51.755689 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:54:51.755689 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:54:51.755689 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98218676-0e95-45b0-877f-4b0f7107048c could not be found. Aug 09 18:54:51.755689 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:54:51.755689 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:54:51.755689 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:54:51.755689 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:54:51.755689 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:54:51.755689 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:54:51.755689 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:54:51.755689 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:54:51.755689 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:54:51.756901 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:54:51.756901 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:54:51.756901 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:54:51.756901 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:54:51.756901 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:54:51.756901 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:54:51.756901 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:54:51.756901 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98218676-0e95-45b0-877f-4b0f7107048c could not be found. Aug 09 18:54:51.756901 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:54:51.756901 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:54:51.756901 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:54:51.756901 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:54:51.756901 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:54:51.756901 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:54:51.756901 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:54:51.756901 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:54:51.756901 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98218676-0e95-45b0-877f-4b0f7107048c could not be found. Aug 09 18:54:51.756901 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:54:51.758127 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f6768879-5dbb-4aa9-96c9-d8d92e0f9fa0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Returning 404 to user: Instance 98218676-0e95-45b0-877f-4b0f7107048c could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:54:51.758127 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f6768879-5dbb-4aa9-96c9-d8d92e0f9fa0 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c" status: 404 len: 111 microversion: 2.1 time: 0.056717 Aug 09 18:54:51.758127 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 381/732] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:54:51 2022] GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:54:51.772846 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-183ce838-e908-4ecc-a8ca-9a001c6e6a66 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '.version_select at 0x7f8d69483a60>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:51.884267 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-183ce838-e908-4ecc-a8ca-9a001c6e6a66 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-576777891" status: 202 len: 0 microversion: 2.1 time: 0.124626 Aug 09 18:54:51.887213 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 382/733] 10.222.0.57 () {58 vars in 1218 bytes} [Tue Aug 9 18:54:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-576777891 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:54:51.988378 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-e8ddc900-711e-42a4-8f75-6f9f8edb70a6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:51.993435 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-e8ddc900-711e-42a4-8f75-6f9f8edb70a6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:51.995274 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-e8ddc900-711e-42a4-8f75-6f9f8edb70a6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:51.996681 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-e8ddc900-711e-42a4-8f75-6f9f8edb70a6 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1730 microversion: 2.20 time: 0.268086 Aug 09 18:54:52.019687 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 352/734] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:54:51 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1730 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:54:52.918086 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-9be2f271-a7c3-42f5-8ecf-b793c8d148c9 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Action: 'create', calling method: .version_select at 0x7f8d694baaf0>, body: {"keypair": {"name": "tempest-keypair-559630473", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEffNlFHGLZ4q0z5GaB2Vv+T2t2EUfq68oruUNxJCRT9Xz4a1xb4HJV0Gf7ttgmUlhCxm1wddMQ5GdfGsNeGSEkr5UcLkH/xGDjVfEmgLYe0eJetVKd3qemcWJTKgQFxA=="}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:54:52.943029 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-9be2f271-a7c3-42f5-8ecf-b793c8d148c9 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Getting quotas for project 4a745db383cb452187f7c82b9977c09b. Resources: {'key_pairs'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:54:52.949893 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-9be2f271-a7c3-42f5-8ecf-b793c8d148c9 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Getting quotas for user 00491255f4b44125b6dc9f816c9bbb58 and project 4a745db383cb452187f7c82b9977c09b. Resources: {'key_pairs'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:54:53.032771 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-82f41945-cc0e-4d67-b9d3-ecda7c0731dc tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:53.033370 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-82f41945-cc0e-4d67-b9d3-ecda7c0731dc tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:53.039658 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-82f41945-cc0e-4d67-b9d3-ecda7c0731dc tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:53.040391 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-82f41945-cc0e-4d67-b9d3-ecda7c0731dc tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:53.040982 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-82f41945-cc0e-4d67-b9d3-ecda7c0731dc tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:53.041916 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-82f41945-cc0e-4d67-b9d3-ecda7c0731dc tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:53.042547 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-82f41945-cc0e-4d67-b9d3-ecda7c0731dc tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:53.043168 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-82f41945-cc0e-4d67-b9d3-ecda7c0731dc tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:53.049492 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-9be2f271-a7c3-42f5-8ecf-b793c8d148c9 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.136142 Aug 09 18:54:53.056515 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 383/735] 10.222.0.57 () {60 vars in 1159 bytes} [Tue Aug 9 18:54:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:54:53.372241 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-82f41945-cc0e-4d67-b9d3-ecda7c0731dc tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:53.381914 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-82f41945-cc0e-4d67-b9d3-ecda7c0731dc tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:53.383913 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-82f41945-cc0e-4d67-b9d3-ecda7c0731dc tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:53.385384 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-82f41945-cc0e-4d67-b9d3-ecda7c0731dc tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1730 microversion: 2.20 time: 0.356966 Aug 09 18:54:53.402956 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 353/736] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:54:53 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1730 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:54:54.411232 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f0a27849-239b-4ff3-a4a9-6b2c3dd12246 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:54.411973 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-f0a27849-239b-4ff3-a4a9-6b2c3dd12246 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:54.418863 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f0a27849-239b-4ff3-a4a9-6b2c3dd12246 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:54.419352 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f0a27849-239b-4ff3-a4a9-6b2c3dd12246 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:54.419783 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f0a27849-239b-4ff3-a4a9-6b2c3dd12246 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:54.420484 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f0a27849-239b-4ff3-a4a9-6b2c3dd12246 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:54.421017 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f0a27849-239b-4ff3-a4a9-6b2c3dd12246 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:54.421436 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f0a27849-239b-4ff3-a4a9-6b2c3dd12246 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:54.591818 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f0a27849-239b-4ff3-a4a9-6b2c3dd12246 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:54.603288 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f0a27849-239b-4ff3-a4a9-6b2c3dd12246 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:54.604927 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f0a27849-239b-4ff3-a4a9-6b2c3dd12246 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:54.606353 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f0a27849-239b-4ff3-a4a9-6b2c3dd12246 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1730 microversion: 2.20 time: 0.199003 Aug 09 18:54:54.607098 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 384/737] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:54:54 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1730 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:54:55.630810 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-320ae918-3577-40b5-95bf-23c3886a4161 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:55.632053 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-320ae918-3577-40b5-95bf-23c3886a4161 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:55.643904 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-320ae918-3577-40b5-95bf-23c3886a4161 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:55.644489 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-320ae918-3577-40b5-95bf-23c3886a4161 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:55.644997 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-320ae918-3577-40b5-95bf-23c3886a4161 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:55.647915 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-320ae918-3577-40b5-95bf-23c3886a4161 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:55.648621 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-320ae918-3577-40b5-95bf-23c3886a4161 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:55.649248 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-320ae918-3577-40b5-95bf-23c3886a4161 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:55.907926 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-320ae918-3577-40b5-95bf-23c3886a4161 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:55.918131 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-320ae918-3577-40b5-95bf-23c3886a4161 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:55.926578 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-320ae918-3577-40b5-95bf-23c3886a4161 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:55.927786 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-320ae918-3577-40b5-95bf-23c3886a4161 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1730 microversion: 2.20 time: 0.301389 Aug 09 18:54:55.944639 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 354/738] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:54:55 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1730 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:54:56.028265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-bce5dd0c-0270-47d9-9dd3-cbef020b9b01 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1456313133", "imageRef": "124dd477-ccfa-4be3-9973-6b1f33b47df8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c83a464f-4efd-4554-9508-d2b73d3a8a45"}], "security_groups": [{"name": "tempest-securitygroup--705637464"}], "key_name": "tempest-keypair-559630473", "user_data": "}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:54:56.179802 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.network.neutron [None req-bce5dd0c-0270-47d9-9dd3-cbef020b9b01 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] validate_networks() for [('c83a464f-4efd-4554-9508-d2b73d3a8a45', None, None, None, None, None)] {{(pid=124725) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:54:56.952523 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-bce5dd0c-0270-47d9-9dd3-cbef020b9b01 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Flavor limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:54:56.953369 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-bce5dd0c-0270-47d9-9dd3-cbef020b9b01 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Image limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:54:56.954205 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-bce5dd0c-0270-47d9-9dd3-cbef020b9b01 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Flavor pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:54:56.954794 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-bce5dd0c-0270-47d9-9dd3-cbef020b9b01 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Image pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:54:56.955372 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-bce5dd0c-0270-47d9-9dd3-cbef020b9b01 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:54:56.966461 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bce5dd0c-0270-47d9-9dd3-cbef020b9b01 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:56.967236 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bce5dd0c-0270-47d9-9dd3-cbef020b9b01 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:56.968377 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bce5dd0c-0270-47d9-9dd3-cbef020b9b01 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:56.969560 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bce5dd0c-0270-47d9-9dd3-cbef020b9b01 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:56.970211 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bce5dd0c-0270-47d9-9dd3-cbef020b9b01 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:56.970796 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bce5dd0c-0270-47d9-9dd3-cbef020b9b01 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:56.971442 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-43441312-333c-420d-afc1-f00c02469882 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:56.972134 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-43441312-333c-420d-afc1-f00c02469882 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:56.992577 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-bce5dd0c-0270-47d9-9dd3-cbef020b9b01 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Getting quotas for project 4a745db383cb452187f7c82b9977c09b. Resources: {'cores', 'ram', 'instances'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:54:56.993282 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-43441312-333c-420d-afc1-f00c02469882 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:56.993971 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-43441312-333c-420d-afc1-f00c02469882 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:56.994713 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-43441312-333c-420d-afc1-f00c02469882 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:56.995757 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-43441312-333c-420d-afc1-f00c02469882 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:56.996478 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-43441312-333c-420d-afc1-f00c02469882 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:56.997182 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-43441312-333c-420d-afc1-f00c02469882 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:56.997508 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-bce5dd0c-0270-47d9-9dd3-cbef020b9b01 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Getting quotas for user 00491255f4b44125b6dc9f816c9bbb58 and project 4a745db383cb452187f7c82b9977c09b. Resources: {'cores', 'ram', 'instances'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:54:57.015918 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-bce5dd0c-0270-47d9-9dd3-cbef020b9b01 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Going to run 1 instances... {{(pid=124725) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:54:57.020211 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-bce5dd0c-0270-47d9-9dd3-cbef020b9b01 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: f349cf3d-5117-4617-ad83-8c0cc44f5bd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='124dd477-ccfa-4be3-9973-6b1f33b47df8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:54:57.152822 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-43441312-333c-420d-afc1-f00c02469882 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:57.166124 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-43441312-333c-420d-afc1-f00c02469882 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:57.168182 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-43441312-333c-420d-afc1-f00c02469882 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:57.169409 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-43441312-333c-420d-afc1-f00c02469882 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1730 microversion: 2.20 time: 0.221061 Aug 09 18:54:57.170202 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 355/739] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:54:56 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1730 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:54:57.184543 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-bce5dd0c-0270-47d9-9dd3-cbef020b9b01 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.160634 Aug 09 18:54:57.185293 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 385/740] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 9 18:54:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 1162 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:54:57.200725 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-7cf59c81-4e8a-479b-b1c2-b495d785823d tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:57.201643 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-7cf59c81-4e8a-479b-b1c2-b495d785823d tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: f349cf3d-5117-4617-ad83-8c0cc44f5bd5] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:57.282281 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-7cf59c81-4e8a-479b-b1c2-b495d785823d tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:57.297540 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-7cf59c81-4e8a-479b-b1c2-b495d785823d tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5" status: 200 len: 1241 microversion: 2.1 time: 0.101086 Aug 09 18:54:57.301997 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 356/741] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:54:57 2022] GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5 => generated 1241 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:54:58.195873 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-83a2a73c-84cb-40c1-8793-202a999cdda9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:58.196536 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-83a2a73c-84cb-40c1-8793-202a999cdda9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:58.202748 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-83a2a73c-84cb-40c1-8793-202a999cdda9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:58.203240 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-83a2a73c-84cb-40c1-8793-202a999cdda9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:58.203760 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-83a2a73c-84cb-40c1-8793-202a999cdda9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:58.204676 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-83a2a73c-84cb-40c1-8793-202a999cdda9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:58.205130 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-83a2a73c-84cb-40c1-8793-202a999cdda9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:58.205574 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-83a2a73c-84cb-40c1-8793-202a999cdda9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:58.326152 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-9ad6af8d-7764-47fd-9175-ce8c837454e3 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:58.326821 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-9ad6af8d-7764-47fd-9175-ce8c837454e3 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: f349cf3d-5117-4617-ad83-8c0cc44f5bd5] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:58.336341 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9ad6af8d-7764-47fd-9175-ce8c837454e3 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:58.337096 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9ad6af8d-7764-47fd-9175-ce8c837454e3 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:58.337761 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9ad6af8d-7764-47fd-9175-ce8c837454e3 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:58.338632 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9ad6af8d-7764-47fd-9175-ce8c837454e3 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:58.339249 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9ad6af8d-7764-47fd-9175-ce8c837454e3 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:58.339833 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9ad6af8d-7764-47fd-9175-ce8c837454e3 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:58.353581 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-83a2a73c-84cb-40c1-8793-202a999cdda9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:58.364695 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-83a2a73c-84cb-40c1-8793-202a999cdda9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:58.366230 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-83a2a73c-84cb-40c1-8793-202a999cdda9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:58.367812 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-83a2a73c-84cb-40c1-8793-202a999cdda9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1730 microversion: 2.20 time: 0.176258 Aug 09 18:54:58.383930 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 386/742] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:54:58 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1730 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:54:58.415790 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-9ad6af8d-7764-47fd-9175-ce8c837454e3 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:58.423873 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-9ad6af8d-7764-47fd-9175-ce8c837454e3 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5" status: 200 len: 1245 microversion: 2.1 time: 0.109643 Aug 09 18:54:58.424384 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 357/743] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:54:58 2022] GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5 => generated 1245 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:54:59.392871 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-2e4d7122-5ca0-4d18-ab96-3a2ce77764b9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:59.393508 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-2e4d7122-5ca0-4d18-ab96-3a2ce77764b9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:59.399859 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2e4d7122-5ca0-4d18-ab96-3a2ce77764b9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:59.400335 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2e4d7122-5ca0-4d18-ab96-3a2ce77764b9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:59.400767 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2e4d7122-5ca0-4d18-ab96-3a2ce77764b9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:59.403060 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2e4d7122-5ca0-4d18-ab96-3a2ce77764b9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:59.403523 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2e4d7122-5ca0-4d18-ab96-3a2ce77764b9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:59.403955 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2e4d7122-5ca0-4d18-ab96-3a2ce77764b9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:59.444088 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-a2698cd4-028c-47b2-afe8-2eb73838b109 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:54:59.444702 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-a2698cd4-028c-47b2-afe8-2eb73838b109 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: f349cf3d-5117-4617-ad83-8c0cc44f5bd5] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:54:59.456448 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a2698cd4-028c-47b2-afe8-2eb73838b109 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:59.456954 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a2698cd4-028c-47b2-afe8-2eb73838b109 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:59.457636 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a2698cd4-028c-47b2-afe8-2eb73838b109 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:59.458296 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a2698cd4-028c-47b2-afe8-2eb73838b109 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:54:59.458781 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a2698cd4-028c-47b2-afe8-2eb73838b109 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:54:59.459201 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a2698cd4-028c-47b2-afe8-2eb73838b109 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:54:59.527272 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-a2698cd4-028c-47b2-afe8-2eb73838b109 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:59.535701 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-a2698cd4-028c-47b2-afe8-2eb73838b109 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5" status: 200 len: 1245 microversion: 2.1 time: 0.095365 Aug 09 18:54:59.536281 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 358/744] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:54:59 2022] GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5 => generated 1245 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:54:59.550774 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-2e4d7122-5ca0-4d18-ab96-3a2ce77764b9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:59.559920 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-2e4d7122-5ca0-4d18-ab96-3a2ce77764b9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:59.562112 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-2e4d7122-5ca0-4d18-ab96-3a2ce77764b9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:54:59.563751 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-2e4d7122-5ca0-4d18-ab96-3a2ce77764b9 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1730 microversion: 2.20 time: 0.174727 Aug 09 18:54:59.564555 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 387/745] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:54:59 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:55:00.556144 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-be186dfb-2b94-4575-a574-f19fcae42016 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:00.556759 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-be186dfb-2b94-4575-a574-f19fcae42016 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: f349cf3d-5117-4617-ad83-8c0cc44f5bd5] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:00.563424 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-be186dfb-2b94-4575-a574-f19fcae42016 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:00.563895 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-be186dfb-2b94-4575-a574-f19fcae42016 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:00.564452 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-be186dfb-2b94-4575-a574-f19fcae42016 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:00.565115 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-be186dfb-2b94-4575-a574-f19fcae42016 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:00.565595 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-be186dfb-2b94-4575-a574-f19fcae42016 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:00.566015 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-be186dfb-2b94-4575-a574-f19fcae42016 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:00.589910 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5ffc272d-56a3-4152-914d-4e71e31df670 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:00.590519 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-5ffc272d-56a3-4152-914d-4e71e31df670 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:00.598070 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5ffc272d-56a3-4152-914d-4e71e31df670 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:00.603273 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5ffc272d-56a3-4152-914d-4e71e31df670 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:00.603273 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5ffc272d-56a3-4152-914d-4e71e31df670 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:00.603273 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5ffc272d-56a3-4152-914d-4e71e31df670 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:00.603273 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5ffc272d-56a3-4152-914d-4e71e31df670 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:00.603790 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5ffc272d-56a3-4152-914d-4e71e31df670 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:00.641501 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-be186dfb-2b94-4575-a574-f19fcae42016 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:00.649289 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-be186dfb-2b94-4575-a574-f19fcae42016 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5" status: 200 len: 1245 microversion: 2.1 time: 0.096963 Aug 09 18:55:00.657248 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 359/746] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:55:00 2022] GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5 => generated 1245 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:55:00.741576 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5ffc272d-56a3-4152-914d-4e71e31df670 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:00.750662 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5ffc272d-56a3-4152-914d-4e71e31df670 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:00.752495 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5ffc272d-56a3-4152-914d-4e71e31df670 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:00.753833 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-5ffc272d-56a3-4152-914d-4e71e31df670 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1730 microversion: 2.20 time: 0.168000 Aug 09 18:55:00.754664 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 388/747] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:55:00 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:55:01.670675 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-dc0230d1-f329-4051-895e-0665f6ddc2b9 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:01.671281 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-dc0230d1-f329-4051-895e-0665f6ddc2b9 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: f349cf3d-5117-4617-ad83-8c0cc44f5bd5] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:01.678745 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-dc0230d1-f329-4051-895e-0665f6ddc2b9 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:01.679226 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-dc0230d1-f329-4051-895e-0665f6ddc2b9 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:01.679652 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-dc0230d1-f329-4051-895e-0665f6ddc2b9 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:01.680344 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-dc0230d1-f329-4051-895e-0665f6ddc2b9 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:01.680826 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-dc0230d1-f329-4051-895e-0665f6ddc2b9 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:01.681245 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-dc0230d1-f329-4051-895e-0665f6ddc2b9 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:01.746474 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-dc0230d1-f329-4051-895e-0665f6ddc2b9 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:01.754415 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-dc0230d1-f329-4051-895e-0665f6ddc2b9 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5" status: 200 len: 1237 microversion: 2.1 time: 0.087631 Aug 09 18:55:01.755122 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 360/748] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:55:01 2022] GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5 => generated 1237 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:55:01.776712 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-edd50cf3-96e4-4f87-9806-e26006e15e76 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:01.777415 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-edd50cf3-96e4-4f87-9806-e26006e15e76 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:01.784628 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-edd50cf3-96e4-4f87-9806-e26006e15e76 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:01.785106 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-edd50cf3-96e4-4f87-9806-e26006e15e76 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:01.785554 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-edd50cf3-96e4-4f87-9806-e26006e15e76 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:01.786345 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-edd50cf3-96e4-4f87-9806-e26006e15e76 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:01.788008 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-edd50cf3-96e4-4f87-9806-e26006e15e76 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:01.788008 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-edd50cf3-96e4-4f87-9806-e26006e15e76 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:01.934475 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-edd50cf3-96e4-4f87-9806-e26006e15e76 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:01.946903 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-edd50cf3-96e4-4f87-9806-e26006e15e76 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:01.954566 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-edd50cf3-96e4-4f87-9806-e26006e15e76 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:01.954566 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-edd50cf3-96e4-4f87-9806-e26006e15e76 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1730 microversion: 2.20 time: 0.177142 Aug 09 18:55:01.954566 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 389/749] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:55:01 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:55:02.782992 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-fffc0785-9b49-4b44-98b3-2b7ad5bd74be tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:02.783649 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-fffc0785-9b49-4b44-98b3-2b7ad5bd74be tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: f349cf3d-5117-4617-ad83-8c0cc44f5bd5] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:02.790150 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fffc0785-9b49-4b44-98b3-2b7ad5bd74be tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:02.790636 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fffc0785-9b49-4b44-98b3-2b7ad5bd74be tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:02.791073 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fffc0785-9b49-4b44-98b3-2b7ad5bd74be tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:02.791763 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fffc0785-9b49-4b44-98b3-2b7ad5bd74be tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:02.792217 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fffc0785-9b49-4b44-98b3-2b7ad5bd74be tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:02.792638 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fffc0785-9b49-4b44-98b3-2b7ad5bd74be tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:02.856609 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-fffc0785-9b49-4b44-98b3-2b7ad5bd74be tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:02.866453 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-fffc0785-9b49-4b44-98b3-2b7ad5bd74be tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5" status: 200 len: 1301 microversion: 2.1 time: 0.087383 Aug 09 18:55:02.867317 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 361/750] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:55:02 2022] GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5 => generated 1301 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:55:02.975318 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-0e638623-2736-469a-b7bd-ff7dea30e635 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:02.976001 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-0e638623-2736-469a-b7bd-ff7dea30e635 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:02.989717 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0e638623-2736-469a-b7bd-ff7dea30e635 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:02.989717 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0e638623-2736-469a-b7bd-ff7dea30e635 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:02.989717 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0e638623-2736-469a-b7bd-ff7dea30e635 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:02.989717 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0e638623-2736-469a-b7bd-ff7dea30e635 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:02.990304 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0e638623-2736-469a-b7bd-ff7dea30e635 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:02.990304 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0e638623-2736-469a-b7bd-ff7dea30e635 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:03.032210 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-c4974b22-e4c4-478d-b7f8-7f4eda8ebb5f tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:03.034607 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-c4974b22-e4c4-478d-b7f8-7f4eda8ebb5f tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ece2efc3-8ca5-4b96-93cb-42f4065610c6] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:03.040949 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c4974b22-e4c4-478d-b7f8-7f4eda8ebb5f tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:03.041873 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c4974b22-e4c4-478d-b7f8-7f4eda8ebb5f tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:03.042566 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c4974b22-e4c4-478d-b7f8-7f4eda8ebb5f tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:03.044081 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c4974b22-e4c4-478d-b7f8-7f4eda8ebb5f tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:03.044765 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c4974b22-e4c4-478d-b7f8-7f4eda8ebb5f tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:03.047143 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c4974b22-e4c4-478d-b7f8-7f4eda8ebb5f tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:03.054770 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:55:03.099302 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-c4974b22-e4c4-478d-b7f8-7f4eda8ebb5f tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.071039 Aug 09 18:55:03.100586 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 362/751] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 9 18:55:03 2022] GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6/os-volume_attachments => generated 371 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:55:03.171692 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-0e638623-2736-469a-b7bd-ff7dea30e635 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:03.182999 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-0e638623-2736-469a-b7bd-ff7dea30e635 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:03.184540 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-0e638623-2736-469a-b7bd-ff7dea30e635 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:03.185752 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-0e638623-2736-469a-b7bd-ff7dea30e635 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1730 microversion: 2.20 time: 0.214580 Aug 09 18:55:03.197585 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 390/752] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:55:02 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1730 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:55:03.243045 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-464b81c7-6559-4cff-9ed3-1bdd44cac382 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:03.243476 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-464b81c7-6559-4cff-9ed3-1bdd44cac382 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ece2efc3-8ca5-4b96-93cb-42f4065610c6] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:03.251507 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-464b81c7-6559-4cff-9ed3-1bdd44cac382 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:03.252285 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-464b81c7-6559-4cff-9ed3-1bdd44cac382 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:03.252787 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-464b81c7-6559-4cff-9ed3-1bdd44cac382 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:03.253508 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-464b81c7-6559-4cff-9ed3-1bdd44cac382 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:03.254051 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-464b81c7-6559-4cff-9ed3-1bdd44cac382 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:03.254475 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-464b81c7-6559-4cff-9ed3-1bdd44cac382 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:03.287221 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-464b81c7-6559-4cff-9ed3-1bdd44cac382 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6/os-volume_attachments/6e68e5f7-647d-4919-a4b0-fca78fd64db8" status: 200 len: 194 microversion: 2.1 time: 0.048491 Aug 09 18:55:03.287822 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 363/753] 10.222.0.57 () {58 vars in 1413 bytes} [Tue Aug 9 18:55:03 2022] GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6/os-volume_attachments/6e68e5f7-647d-4919-a4b0-fca78fd64db8 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:55:03.298378 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f78dd4d4-adf9-4a64-8e25-75290f71e304 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:03.299207 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-f78dd4d4-adf9-4a64-8e25-75290f71e304 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ece2efc3-8ca5-4b96-93cb-42f4065610c6] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:03.316753 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f78dd4d4-adf9-4a64-8e25-75290f71e304 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:03.321054 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f78dd4d4-adf9-4a64-8e25-75290f71e304 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:03.321054 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f78dd4d4-adf9-4a64-8e25-75290f71e304 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:03.321054 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f78dd4d4-adf9-4a64-8e25-75290f71e304 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:03.321054 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f78dd4d4-adf9-4a64-8e25-75290f71e304 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:03.321451 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f78dd4d4-adf9-4a64-8e25-75290f71e304 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:03.411231 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.objects.instance [None req-f78dd4d4-adf9-4a64-8e25-75290f71e304 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lazy-loading 'services' on Instance uuid ece2efc3-8ca5-4b96-93cb-42f4065610c6 {{(pid=124725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:55:03.688620 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f78dd4d4-adf9-4a64-8e25-75290f71e304 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6/os-volume_attachments/6e68e5f7-647d-4919-a4b0-fca78fd64db8" status: 202 len: 0 microversion: 2.1 time: 0.393448 Aug 09 18:55:03.689227 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 391/754] 10.222.0.57 () {58 vars in 1416 bytes} [Tue Aug 9 18:55:03 2022] DELETE /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6/os-volume_attachments/6e68e5f7-647d-4919-a4b0-fca78fd64db8 => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:55:03.888697 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-d3ba37ea-0d42-4f39-aec6-47c54562ad64 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:03.889295 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-d3ba37ea-0d42-4f39-aec6-47c54562ad64 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: f349cf3d-5117-4617-ad83-8c0cc44f5bd5] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:03.896379 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d3ba37ea-0d42-4f39-aec6-47c54562ad64 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:03.896862 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d3ba37ea-0d42-4f39-aec6-47c54562ad64 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:03.897299 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d3ba37ea-0d42-4f39-aec6-47c54562ad64 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:03.898001 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d3ba37ea-0d42-4f39-aec6-47c54562ad64 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:03.898468 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d3ba37ea-0d42-4f39-aec6-47c54562ad64 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:03.898864 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d3ba37ea-0d42-4f39-aec6-47c54562ad64 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:03.962962 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-d3ba37ea-0d42-4f39-aec6-47c54562ad64 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:03.971471 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-d3ba37ea-0d42-4f39-aec6-47c54562ad64 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5" status: 200 len: 1299 microversion: 2.1 time: 0.087023 Aug 09 18:55:03.972044 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 364/755] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:55:03 2022] GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5 => generated 1299 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:55:04.212206 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-6c687145-a276-4729-ae2c-c1ccc95298de tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:04.212916 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-6c687145-a276-4729-ae2c-c1ccc95298de tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:04.227842 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6c687145-a276-4729-ae2c-c1ccc95298de tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:04.229281 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6c687145-a276-4729-ae2c-c1ccc95298de tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:04.229957 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6c687145-a276-4729-ae2c-c1ccc95298de tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:04.232736 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6c687145-a276-4729-ae2c-c1ccc95298de tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:04.232736 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6c687145-a276-4729-ae2c-c1ccc95298de tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:04.232736 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6c687145-a276-4729-ae2c-c1ccc95298de tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:04.401415 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-6c687145-a276-4729-ae2c-c1ccc95298de tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:04.410479 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-6c687145-a276-4729-ae2c-c1ccc95298de tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:04.412095 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-6c687145-a276-4729-ae2c-c1ccc95298de tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:04.413271 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-6c687145-a276-4729-ae2c-c1ccc95298de tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1730 microversion: 2.20 time: 0.205803 Aug 09 18:55:04.413870 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 392/756] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:55:04 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1730 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:55:04.940863 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-ed18b77e-44d7-414b-bd65-9c53f5fba880 req-2f0dded6-94e6-4058-84b7-d31f3cc9705b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f84c5e3-7213-4bd2-ad7c-4794aab9d631", "name": "network-vif-plugged", "status": "completed", "tag": "d2e3768b-d787-45b4-941d-9253bd20d687"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:55:04.951932 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-ed18b77e-44d7-414b-bd65-9c53f5fba880 req-2f0dded6-94e6-4058-84b7-d31f3cc9705b service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:04.952485 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-ed18b77e-44d7-414b-bd65-9c53f5fba880 req-2f0dded6-94e6-4058-84b7-d31f3cc9705b service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:04.953674 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-ed18b77e-44d7-414b-bd65-9c53f5fba880 req-2f0dded6-94e6-4058-84b7-d31f3cc9705b service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:04.964450 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-ed18b77e-44d7-414b-bd65-9c53f5fba880 req-2f0dded6-94e6-4058-84b7-d31f3cc9705b service nova] Creating event network-vif-plugged:d2e3768b-d787-45b4-941d-9253bd20d687 for instance 8f84c5e3-7213-4bd2-ad7c-4794aab9d631 on hv-cinder-82660 Aug 09 18:55:04.969507 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-ed18b77e-44d7-414b-bd65-9c53f5fba880 req-2f0dded6-94e6-4058-84b7-d31f3cc9705b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033325 Aug 09 18:55:04.970202 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 365/757] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:55:04.996174 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a1c0ef01-0ed7-46c3-a8b3-131fb6720eff tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:04.997080 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-a1c0ef01-0ed7-46c3-a8b3-131fb6720eff tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: f349cf3d-5117-4617-ad83-8c0cc44f5bd5] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:05.007039 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a1c0ef01-0ed7-46c3-a8b3-131fb6720eff tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:05.018696 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a1c0ef01-0ed7-46c3-a8b3-131fb6720eff tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:05.018696 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a1c0ef01-0ed7-46c3-a8b3-131fb6720eff tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:05.018696 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a1c0ef01-0ed7-46c3-a8b3-131fb6720eff tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:05.018696 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a1c0ef01-0ed7-46c3-a8b3-131fb6720eff tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:05.019302 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a1c0ef01-0ed7-46c3-a8b3-131fb6720eff tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:05.028735 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=98 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:55:05.147642 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-a1c0ef01-0ed7-46c3-a8b3-131fb6720eff tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:05.161685 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-a1c0ef01-0ed7-46c3-a8b3-131fb6720eff tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5" status: 200 len: 1366 microversion: 2.1 time: 0.170632 Aug 09 18:55:05.162293 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 393/758] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:55:04 2022] GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:55:05.437177 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-4691db8c-4be0-4388-bf16-990eb2563d65 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:05.437933 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-4691db8c-4be0-4388-bf16-990eb2563d65 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:05.444172 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4691db8c-4be0-4388-bf16-990eb2563d65 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:05.444657 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4691db8c-4be0-4388-bf16-990eb2563d65 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:05.445095 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4691db8c-4be0-4388-bf16-990eb2563d65 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:05.445830 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4691db8c-4be0-4388-bf16-990eb2563d65 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:05.446282 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4691db8c-4be0-4388-bf16-990eb2563d65 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:05.446701 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-4691db8c-4be0-4388-bf16-990eb2563d65 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:05.579148 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-4691db8c-4be0-4388-bf16-990eb2563d65 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:05.587144 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-4691db8c-4be0-4388-bf16-990eb2563d65 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:05.588657 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-4691db8c-4be0-4388-bf16-990eb2563d65 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:05.589840 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-4691db8c-4be0-4388-bf16-990eb2563d65 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1730 microversion: 2.20 time: 0.157218 Aug 09 18:55:05.590392 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 366/759] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:55:05 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:55:05.807325 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-2d3747b7-ad4d-4319-a2fb-99aa72564167 req-01f42585-bb9a-4085-9ea2-6c775a568fd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f349cf3d-5117-4617-ad83-8c0cc44f5bd5", "tag": "7c846f90-8370-4cf7-affb-6469e7219d6f"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:55:05.827405 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-2d3747b7-ad4d-4319-a2fb-99aa72564167 req-01f42585-bb9a-4085-9ea2-6c775a568fd8 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:05.836876 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-2d3747b7-ad4d-4319-a2fb-99aa72564167 req-01f42585-bb9a-4085-9ea2-6c775a568fd8 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:05.837483 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-2d3747b7-ad4d-4319-a2fb-99aa72564167 req-01f42585-bb9a-4085-9ea2-6c775a568fd8 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:05.852145 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-2d3747b7-ad4d-4319-a2fb-99aa72564167 req-01f42585-bb9a-4085-9ea2-6c775a568fd8 service nova] Creating event network-changed:7c846f90-8370-4cf7-affb-6469e7219d6f for instance f349cf3d-5117-4617-ad83-8c0cc44f5bd5 on hv-cinder-82660 Aug 09 18:55:05.858355 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-2d3747b7-ad4d-4319-a2fb-99aa72564167 req-01f42585-bb9a-4085-9ea2-6c775a568fd8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058167 Aug 09 18:55:05.859379 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 394/760] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:55:05.932779 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-37eb39eb-7d5c-4260-90a5-062b7dff3d7a tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:05.933560 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-37eb39eb-7d5c-4260-90a5-062b7dff3d7a tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ece2efc3-8ca5-4b96-93cb-42f4065610c6] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:05.942070 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-37eb39eb-7d5c-4260-90a5-062b7dff3d7a tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:05.943284 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-37eb39eb-7d5c-4260-90a5-062b7dff3d7a tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:05.943284 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-37eb39eb-7d5c-4260-90a5-062b7dff3d7a tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:05.943912 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-37eb39eb-7d5c-4260-90a5-062b7dff3d7a tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:05.944608 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-37eb39eb-7d5c-4260-90a5-062b7dff3d7a tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:05.945124 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-37eb39eb-7d5c-4260-90a5-062b7dff3d7a tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:05.976798 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-37eb39eb-7d5c-4260-90a5-062b7dff3d7a tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6/os-volume_attachments/0b40c26e-b489-4b00-8b07-669b9d569f3f" status: 200 len: 194 microversion: 2.1 time: 0.048010 Aug 09 18:55:05.977401 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 367/761] 10.222.0.57 () {58 vars in 1413 bytes} [Tue Aug 9 18:55:05 2022] GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6/os-volume_attachments/0b40c26e-b489-4b00-8b07-669b9d569f3f => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:55:05.988732 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-de5b4deb-77dd-411b-a2a5-0462dce8e7da tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:05.989409 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-de5b4deb-77dd-411b-a2a5-0462dce8e7da tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ece2efc3-8ca5-4b96-93cb-42f4065610c6] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:05.995696 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-de5b4deb-77dd-411b-a2a5-0462dce8e7da tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:05.996115 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-de5b4deb-77dd-411b-a2a5-0462dce8e7da tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:05.996550 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-de5b4deb-77dd-411b-a2a5-0462dce8e7da tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:05.997242 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-de5b4deb-77dd-411b-a2a5-0462dce8e7da tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:05.997751 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-de5b4deb-77dd-411b-a2a5-0462dce8e7da tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:05.998177 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-de5b4deb-77dd-411b-a2a5-0462dce8e7da tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:06.113749 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.objects.instance [None req-de5b4deb-77dd-411b-a2a5-0462dce8e7da tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lazy-loading 'services' on Instance uuid ece2efc3-8ca5-4b96-93cb-42f4065610c6 {{(pid=124725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:55:06.184531 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-94040e69-e14c-4d98-9b2e-660b428994fb tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:06.186394 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-94040e69-e14c-4d98-9b2e-660b428994fb tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: f349cf3d-5117-4617-ad83-8c0cc44f5bd5] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:06.195068 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-94040e69-e14c-4d98-9b2e-660b428994fb tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:06.195657 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-94040e69-e14c-4d98-9b2e-660b428994fb tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:06.196163 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-94040e69-e14c-4d98-9b2e-660b428994fb tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:06.196949 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-94040e69-e14c-4d98-9b2e-660b428994fb tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:06.197477 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-94040e69-e14c-4d98-9b2e-660b428994fb tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:06.198026 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-94040e69-e14c-4d98-9b2e-660b428994fb tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:06.320930 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-de5b4deb-77dd-411b-a2a5-0462dce8e7da tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6/os-volume_attachments/0b40c26e-b489-4b00-8b07-669b9d569f3f" status: 202 len: 0 microversion: 2.1 time: 0.336173 Aug 09 18:55:06.322270 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 395/762] 10.222.0.57 () {58 vars in 1416 bytes} [Tue Aug 9 18:55:05 2022] DELETE /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6/os-volume_attachments/0b40c26e-b489-4b00-8b07-669b9d569f3f => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:55:06.362371 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-94040e69-e14c-4d98-9b2e-660b428994fb tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:06.370785 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-94040e69-e14c-4d98-9b2e-660b428994fb tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5" status: 200 len: 1366 microversion: 2.1 time: 0.191650 Aug 09 18:55:06.385361 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 368/763] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:55:06 2022] GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:55:06.615733 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-184cae37-1913-4ca8-a5bd-dee6b5c7d89e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:06.616537 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-184cae37-1913-4ca8-a5bd-dee6b5c7d89e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:06.626359 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-184cae37-1913-4ca8-a5bd-dee6b5c7d89e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:06.627254 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-184cae37-1913-4ca8-a5bd-dee6b5c7d89e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:06.627457 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-184cae37-1913-4ca8-a5bd-dee6b5c7d89e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:06.628330 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-184cae37-1913-4ca8-a5bd-dee6b5c7d89e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:06.628845 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-184cae37-1913-4ca8-a5bd-dee6b5c7d89e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:06.629270 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-184cae37-1913-4ca8-a5bd-dee6b5c7d89e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:06.808634 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-184cae37-1913-4ca8-a5bd-dee6b5c7d89e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:06.821599 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-184cae37-1913-4ca8-a5bd-dee6b5c7d89e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:06.823543 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-184cae37-1913-4ca8-a5bd-dee6b5c7d89e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:06.824808 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-184cae37-1913-4ca8-a5bd-dee6b5c7d89e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1730 microversion: 2.20 time: 0.215950 Aug 09 18:55:06.825625 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 396/764] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:55:06 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1730 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:55:07.392743 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-59e7b311-c6e1-4ce3-9662-4e9ef6ffebe7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:07.393369 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-59e7b311-c6e1-4ce3-9662-4e9ef6ffebe7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: f349cf3d-5117-4617-ad83-8c0cc44f5bd5] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:07.395854 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell0:SELECT=2 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:55:07.401103 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-59e7b311-c6e1-4ce3-9662-4e9ef6ffebe7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:07.401654 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-59e7b311-c6e1-4ce3-9662-4e9ef6ffebe7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:07.402295 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-59e7b311-c6e1-4ce3-9662-4e9ef6ffebe7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:07.403162 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-59e7b311-c6e1-4ce3-9662-4e9ef6ffebe7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:07.403876 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-59e7b311-c6e1-4ce3-9662-4e9ef6ffebe7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:07.404458 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-59e7b311-c6e1-4ce3-9662-4e9ef6ffebe7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:07.563920 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-59e7b311-c6e1-4ce3-9662-4e9ef6ffebe7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:07.572463 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-59e7b311-c6e1-4ce3-9662-4e9ef6ffebe7 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5" status: 200 len: 1366 microversion: 2.1 time: 0.184180 Aug 09 18:55:07.573061 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 369/765] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:55:07 2022] GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5 => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:55:07.851961 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-6d033962-58cb-41cb-b0ac-020ad8ae8fd2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:07.853145 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-6d033962-58cb-41cb-b0ac-020ad8ae8fd2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:07.857130 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=2 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:55:07.858374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=10 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:55:07.860528 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:55:07.865881 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6d033962-58cb-41cb-b0ac-020ad8ae8fd2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:07.867017 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6d033962-58cb-41cb-b0ac-020ad8ae8fd2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:07.867554 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6d033962-58cb-41cb-b0ac-020ad8ae8fd2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:07.868812 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6d033962-58cb-41cb-b0ac-020ad8ae8fd2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:07.870271 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6d033962-58cb-41cb-b0ac-020ad8ae8fd2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:07.870796 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6d033962-58cb-41cb-b0ac-020ad8ae8fd2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:08.020140 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-6d033962-58cb-41cb-b0ac-020ad8ae8fd2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:08.028428 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-6d033962-58cb-41cb-b0ac-020ad8ae8fd2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:08.029949 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-6d033962-58cb-41cb-b0ac-020ad8ae8fd2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:08.032292 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-6d033962-58cb-41cb-b0ac-020ad8ae8fd2 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1730 microversion: 2.20 time: 0.187187 Aug 09 18:55:08.039887 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 397/766] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:55:07 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:55:08.590612 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-151ade4d-6ea4-47ee-9464-68da9809eee1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:08.593100 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-151ade4d-6ea4-47ee-9464-68da9809eee1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ece2efc3-8ca5-4b96-93cb-42f4065610c6] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:08.594213 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-4a3df379-10df-45e3-bd41-2271ca83d9de tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:08.594934 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-4a3df379-10df-45e3-bd41-2271ca83d9de tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: f349cf3d-5117-4617-ad83-8c0cc44f5bd5] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:08.600227 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-151ade4d-6ea4-47ee-9464-68da9809eee1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:08.601073 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-151ade4d-6ea4-47ee-9464-68da9809eee1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:08.615733 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-151ade4d-6ea4-47ee-9464-68da9809eee1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:08.616493 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4a3df379-10df-45e3-bd41-2271ca83d9de tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:08.616601 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-151ade4d-6ea4-47ee-9464-68da9809eee1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:08.616709 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4a3df379-10df-45e3-bd41-2271ca83d9de tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:08.616810 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-151ade4d-6ea4-47ee-9464-68da9809eee1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:08.616909 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4a3df379-10df-45e3-bd41-2271ca83d9de tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:08.617007 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-151ade4d-6ea4-47ee-9464-68da9809eee1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:08.617103 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4a3df379-10df-45e3-bd41-2271ca83d9de tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:08.617103 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4a3df379-10df-45e3-bd41-2271ca83d9de tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:08.617103 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4a3df379-10df-45e3-bd41-2271ca83d9de tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:08.637976 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-151ade4d-6ea4-47ee-9464-68da9809eee1 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051400 Aug 09 18:55:08.638899 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 370/767] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 9 18:55:08 2022] GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 18:55:08.761037 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-4a3df379-10df-45e3-bd41-2271ca83d9de tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:08.769053 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-7a2e09de-17d2-4102-8e34-ac72b10906fb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:08.769544 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-4a3df379-10df-45e3-bd41-2271ca83d9de tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5" status: 200 len: 1366 microversion: 2.1 time: 0.180118 Aug 09 18:55:08.770118 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 398/768] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:55:08 2022] GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:55:08.771497 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-7a2e09de-17d2-4102-8e34-ac72b10906fb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ece2efc3-8ca5-4b96-93cb-42f4065610c6] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:08.777964 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7a2e09de-17d2-4102-8e34-ac72b10906fb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:08.778530 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7a2e09de-17d2-4102-8e34-ac72b10906fb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:08.779033 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7a2e09de-17d2-4102-8e34-ac72b10906fb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:08.779993 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7a2e09de-17d2-4102-8e34-ac72b10906fb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:08.780518 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7a2e09de-17d2-4102-8e34-ac72b10906fb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:08.781106 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7a2e09de-17d2-4102-8e34-ac72b10906fb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:08.814249 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-7a2e09de-17d2-4102-8e34-ac72b10906fb tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049906 Aug 09 18:55:08.814822 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 371/769] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 9 18:55:08 2022] GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 18:55:08.877617 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f1cfab73-aced-4cb3-b406-6992222b89c9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:08.878138 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-f1cfab73-aced-4cb3-b406-6992222b89c9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ece2efc3-8ca5-4b96-93cb-42f4065610c6] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:08.884601 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f1cfab73-aced-4cb3-b406-6992222b89c9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:08.885074 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f1cfab73-aced-4cb3-b406-6992222b89c9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:08.885577 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f1cfab73-aced-4cb3-b406-6992222b89c9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:08.886265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f1cfab73-aced-4cb3-b406-6992222b89c9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:08.886712 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f1cfab73-aced-4cb3-b406-6992222b89c9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:08.887128 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f1cfab73-aced-4cb3-b406-6992222b89c9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:08.911636 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-f1cfab73-aced-4cb3-b406-6992222b89c9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ece2efc3-8ca5-4b96-93cb-42f4065610c6] Going to try to terminate instance {{(pid=124725) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:55:09.060486 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-78350aeb-7436-4789-9ec8-e015e984bc4e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:09.061105 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-78350aeb-7436-4789-9ec8-e015e984bc4e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:09.067504 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-78350aeb-7436-4789-9ec8-e015e984bc4e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:09.067985 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-78350aeb-7436-4789-9ec8-e015e984bc4e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:09.068416 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-78350aeb-7436-4789-9ec8-e015e984bc4e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:09.069268 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-78350aeb-7436-4789-9ec8-e015e984bc4e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:09.070032 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-78350aeb-7436-4789-9ec8-e015e984bc4e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:09.070637 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-78350aeb-7436-4789-9ec8-e015e984bc4e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:09.192925 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f1cfab73-aced-4cb3-b406-6992222b89c9 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6" status: 204 len: 0 microversion: 2.1 time: 0.319482 Aug 09 18:55:09.194024 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 399/770] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 9 18:55:08 2022] DELETE /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:55:09.203404 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-7e04a610-8c06-4923-9c61-2f9707d5ea90 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:09.204346 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-7e04a610-8c06-4923-9c61-2f9707d5ea90 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ece2efc3-8ca5-4b96-93cb-42f4065610c6] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:09.210800 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-78350aeb-7436-4789-9ec8-e015e984bc4e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:09.211257 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7e04a610-8c06-4923-9c61-2f9707d5ea90 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:09.211771 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7e04a610-8c06-4923-9c61-2f9707d5ea90 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:09.212202 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7e04a610-8c06-4923-9c61-2f9707d5ea90 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:09.212905 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7e04a610-8c06-4923-9c61-2f9707d5ea90 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:09.213350 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7e04a610-8c06-4923-9c61-2f9707d5ea90 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:09.213813 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7e04a610-8c06-4923-9c61-2f9707d5ea90 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:09.220009 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-78350aeb-7436-4789-9ec8-e015e984bc4e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:09.221620 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-78350aeb-7436-4789-9ec8-e015e984bc4e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:09.224581 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-78350aeb-7436-4789-9ec8-e015e984bc4e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1717 microversion: 2.20 time: 0.166627 Aug 09 18:55:09.224581 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 372/771] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:55:09 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1717 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:55:09.353706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-7e04a610-8c06-4923-9c61-2f9707d5ea90 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:09.365310 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-7e04a610-8c06-4923-9c61-2f9707d5ea90 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6" status: 200 len: 1674 microversion: 2.1 time: 0.166031 Aug 09 18:55:09.365932 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 400/772] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:55:09 2022] GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6 => generated 1674 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:55:09.791127 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-eea6844c-58df-4c29-b0b5-58b765bdb675 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:09.791801 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-eea6844c-58df-4c29-b0b5-58b765bdb675 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: f349cf3d-5117-4617-ad83-8c0cc44f5bd5] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:09.798954 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-eea6844c-58df-4c29-b0b5-58b765bdb675 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:09.799451 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-eea6844c-58df-4c29-b0b5-58b765bdb675 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:09.799892 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-eea6844c-58df-4c29-b0b5-58b765bdb675 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:09.800600 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-eea6844c-58df-4c29-b0b5-58b765bdb675 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:09.801054 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-eea6844c-58df-4c29-b0b5-58b765bdb675 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:09.801482 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-eea6844c-58df-4c29-b0b5-58b765bdb675 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:09.937698 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-eea6844c-58df-4c29-b0b5-58b765bdb675 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:09.945312 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-eea6844c-58df-4c29-b0b5-58b765bdb675 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5" status: 200 len: 1366 microversion: 2.1 time: 0.158099 Aug 09 18:55:09.945917 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 373/773] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:55:09 2022] GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:55:10.392768 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-942659f9-d769-47a6-82c1-91378f219454 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:10.393353 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-942659f9-d769-47a6-82c1-91378f219454 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ece2efc3-8ca5-4b96-93cb-42f4065610c6] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:10.399380 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-942659f9-d769-47a6-82c1-91378f219454 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:10.399853 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-942659f9-d769-47a6-82c1-91378f219454 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:10.400276 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-942659f9-d769-47a6-82c1-91378f219454 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:10.400952 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-942659f9-d769-47a6-82c1-91378f219454 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:10.401399 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-942659f9-d769-47a6-82c1-91378f219454 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:10.401853 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-942659f9-d769-47a6-82c1-91378f219454 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:10.535376 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-942659f9-d769-47a6-82c1-91378f219454 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:10.542882 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-942659f9-d769-47a6-82c1-91378f219454 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6" status: 200 len: 1674 microversion: 2.1 time: 0.154272 Aug 09 18:55:10.543453 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 401/774] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:55:10 2022] GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:55:10.967534 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-5765580a-a472-4426-a846-2459b2b1c4cc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:10.968168 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-5765580a-a472-4426-a846-2459b2b1c4cc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: f349cf3d-5117-4617-ad83-8c0cc44f5bd5] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:10.975103 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5765580a-a472-4426-a846-2459b2b1c4cc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:10.975606 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5765580a-a472-4426-a846-2459b2b1c4cc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:10.976036 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5765580a-a472-4426-a846-2459b2b1c4cc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:10.976719 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5765580a-a472-4426-a846-2459b2b1c4cc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:10.977168 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5765580a-a472-4426-a846-2459b2b1c4cc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:10.977622 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5765580a-a472-4426-a846-2459b2b1c4cc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:11.186324 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-5765580a-a472-4426-a846-2459b2b1c4cc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:11.193855 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-5765580a-a472-4426-a846-2459b2b1c4cc tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5" status: 200 len: 1366 microversion: 2.1 time: 0.230156 Aug 09 18:55:11.194525 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 374/775] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:55:10 2022] GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5 => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:55:11.567892 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c58c28f0-6d1d-4e2e-9603-4626fd60de93 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:11.568579 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-c58c28f0-6d1d-4e2e-9603-4626fd60de93 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ece2efc3-8ca5-4b96-93cb-42f4065610c6] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:11.575004 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c58c28f0-6d1d-4e2e-9603-4626fd60de93 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:11.575516 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c58c28f0-6d1d-4e2e-9603-4626fd60de93 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:11.575947 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c58c28f0-6d1d-4e2e-9603-4626fd60de93 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:11.576644 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c58c28f0-6d1d-4e2e-9603-4626fd60de93 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:11.577096 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c58c28f0-6d1d-4e2e-9603-4626fd60de93 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:11.577558 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c58c28f0-6d1d-4e2e-9603-4626fd60de93 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:11.719111 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-c58c28f0-6d1d-4e2e-9603-4626fd60de93 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:11.729805 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-c58c28f0-6d1d-4e2e-9603-4626fd60de93 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6" status: 200 len: 1674 microversion: 2.1 time: 0.167796 Aug 09 18:55:11.744492 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 402/776] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:55:11 2022] GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6 => generated 1674 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:55:12.044638 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-b8469576-e7b9-45d1-8683-dfe444756b67 req-500970d8-3669-45da-b28d-3ed3a425efe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ece2efc3-8ca5-4b96-93cb-42f4065610c6", "name": "network-vif-deleted", "tag": "f68a90d2-e740-4361-a743-b3af796112d5"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:55:12.058736 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-b8469576-e7b9-45d1-8683-dfe444756b67 req-500970d8-3669-45da-b28d-3ed3a425efe5 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:12.059323 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-b8469576-e7b9-45d1-8683-dfe444756b67 req-500970d8-3669-45da-b28d-3ed3a425efe5 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:12.059847 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-b8469576-e7b9-45d1-8683-dfe444756b67 req-500970d8-3669-45da-b28d-3ed3a425efe5 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:12.071934 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-b8469576-e7b9-45d1-8683-dfe444756b67 req-500970d8-3669-45da-b28d-3ed3a425efe5 service nova] Creating event network-vif-deleted:f68a90d2-e740-4361-a743-b3af796112d5 for instance ece2efc3-8ca5-4b96-93cb-42f4065610c6 on hv-cinder-82660 Aug 09 18:55:12.077247 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-b8469576-e7b9-45d1-8683-dfe444756b67 req-500970d8-3669-45da-b28d-3ed3a425efe5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036415 Aug 09 18:55:12.078293 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 375/777] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:55:12.216104 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d022bebd-a283-4ed8-84fd-b9cc7b5a8df8 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:12.218015 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-d022bebd-a283-4ed8-84fd-b9cc7b5a8df8 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: f349cf3d-5117-4617-ad83-8c0cc44f5bd5] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:12.224919 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d022bebd-a283-4ed8-84fd-b9cc7b5a8df8 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:12.225408 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d022bebd-a283-4ed8-84fd-b9cc7b5a8df8 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:12.225874 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d022bebd-a283-4ed8-84fd-b9cc7b5a8df8 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:12.226695 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d022bebd-a283-4ed8-84fd-b9cc7b5a8df8 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:12.228948 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d022bebd-a283-4ed8-84fd-b9cc7b5a8df8 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:12.229372 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d022bebd-a283-4ed8-84fd-b9cc7b5a8df8 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:12.374367 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d022bebd-a283-4ed8-84fd-b9cc7b5a8df8 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:12.386116 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-d022bebd-a283-4ed8-84fd-b9cc7b5a8df8 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5" status: 200 len: 1366 microversion: 2.1 time: 0.173637 Aug 09 18:55:12.387098 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 403/778] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:55:12 2022] GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:55:12.752212 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-36f60268-eec8-4e2c-ae46-3b4e75c778cc tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:12.753187 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-36f60268-eec8-4e2c-ae46-3b4e75c778cc tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ece2efc3-8ca5-4b96-93cb-42f4065610c6] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:12.760185 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-36f60268-eec8-4e2c-ae46-3b4e75c778cc tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:12.760683 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-36f60268-eec8-4e2c-ae46-3b4e75c778cc tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:12.761138 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-36f60268-eec8-4e2c-ae46-3b4e75c778cc tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:12.766311 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-36f60268-eec8-4e2c-ae46-3b4e75c778cc tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:12.768057 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-36f60268-eec8-4e2c-ae46-3b4e75c778cc tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:12.768527 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-36f60268-eec8-4e2c-ae46-3b4e75c778cc tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:12.811889 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-36f60268-eec8-4e2c-ae46-3b4e75c778cc tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:12.812506 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-36f60268-eec8-4e2c-ae46-3b4e75c778cc tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:12.813154 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-36f60268-eec8-4e2c-ae46-3b4e75c778cc tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:12.813991 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.objects.instance [None req-36f60268-eec8-4e2c-ae46-3b4e75c778cc tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lazy-loading 'fault' on Instance uuid ece2efc3-8ca5-4b96-93cb-42f4065610c6 {{(pid=124726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:55:12.861350 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-36f60268-eec8-4e2c-ae46-3b4e75c778cc tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e48ee30c61424ba0c82ac4fc5cd06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8f60ca836d43399989fb32ad78d27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:12.871676 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-36f60268-eec8-4e2c-ae46-3b4e75c778cc tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6" status: 200 len: 1328 microversion: 2.1 time: 0.123860 Aug 09 18:55:12.872270 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 376/779] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:55:12 2022] GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6 => generated 1328 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:55:13.059697 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-7e69ab71-285b-4dcd-b4d8-91e0960c2b0a req-afc0c1c2-3fe5-4d02-a459-9226aac3c9d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f349cf3d-5117-4617-ad83-8c0cc44f5bd5", "name": "network-vif-plugged", "status": "completed", "tag": "7c846f90-8370-4cf7-affb-6469e7219d6f"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:55:13.071910 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-7e69ab71-285b-4dcd-b4d8-91e0960c2b0a req-afc0c1c2-3fe5-4d02-a459-9226aac3c9d8 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:13.072374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-7e69ab71-285b-4dcd-b4d8-91e0960c2b0a req-afc0c1c2-3fe5-4d02-a459-9226aac3c9d8 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:13.072931 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-7e69ab71-285b-4dcd-b4d8-91e0960c2b0a req-afc0c1c2-3fe5-4d02-a459-9226aac3c9d8 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:13.086777 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-7e69ab71-285b-4dcd-b4d8-91e0960c2b0a req-afc0c1c2-3fe5-4d02-a459-9226aac3c9d8 service nova] Creating event network-vif-plugged:7c846f90-8370-4cf7-affb-6469e7219d6f for instance f349cf3d-5117-4617-ad83-8c0cc44f5bd5 on hv-cinder-82660 Aug 09 18:55:13.091911 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-7e69ab71-285b-4dcd-b4d8-91e0960c2b0a req-afc0c1c2-3fe5-4d02-a459-9226aac3c9d8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036601 Aug 09 18:55:13.092556 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 404/780] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:55:13.409606 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-b6ef95e6-e82b-4bb7-ac5d-645722e4b4b6 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:13.410204 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-b6ef95e6-e82b-4bb7-ac5d-645722e4b4b6 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: f349cf3d-5117-4617-ad83-8c0cc44f5bd5] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:13.412729 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:55:13.417550 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b6ef95e6-e82b-4bb7-ac5d-645722e4b4b6 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:13.418051 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b6ef95e6-e82b-4bb7-ac5d-645722e4b4b6 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:13.418484 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b6ef95e6-e82b-4bb7-ac5d-645722e4b4b6 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:13.419209 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b6ef95e6-e82b-4bb7-ac5d-645722e4b4b6 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:13.419661 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b6ef95e6-e82b-4bb7-ac5d-645722e4b4b6 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:13.420084 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b6ef95e6-e82b-4bb7-ac5d-645722e4b4b6 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:13.559593 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-b6ef95e6-e82b-4bb7-ac5d-645722e4b4b6 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:13.567645 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-b6ef95e6-e82b-4bb7-ac5d-645722e4b4b6 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5" status: 200 len: 1366 microversion: 2.1 time: 0.162145 Aug 09 18:55:13.568210 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 377/781] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:55:13 2022] GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:55:13.894417 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-eee02b15-525e-4984-a64e-1a640d7518ca tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:13.895100 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-eee02b15-525e-4984-a64e-1a640d7518ca tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ece2efc3-8ca5-4b96-93cb-42f4065610c6] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:13.901634 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-eee02b15-525e-4984-a64e-1a640d7518ca tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:13.902127 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-eee02b15-525e-4984-a64e-1a640d7518ca tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:13.902560 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-eee02b15-525e-4984-a64e-1a640d7518ca tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:13.903304 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-eee02b15-525e-4984-a64e-1a640d7518ca tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:13.903834 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-eee02b15-525e-4984-a64e-1a640d7518ca tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:13.904261 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-eee02b15-525e-4984-a64e-1a640d7518ca tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:13.918190 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-eee02b15-525e-4984-a64e-1a640d7518ca tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] HTTP exception thrown: Instance ece2efc3-8ca5-4b96-93cb-42f4065610c6 could not be found. Aug 09 18:55:13.919847 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-eee02b15-525e-4984-a64e-1a640d7518ca tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Request method failure captured: Aug 09 18:55:13.919847 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: request: GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6 HTTP/1.1 Aug 09 18:55:13.919847 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept: application/json Aug 09 18:55:13.919847 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Aug 09 18:55:13.919847 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Connection: close Aug 09 18:55:13.919847 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Length: 0 Aug 09 18:55:13.919847 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Type: application/json Aug 09 18:55:13.919847 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Host: 10.222.0.57 Aug 09 18:55:13.919847 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Aug 09 18:55:13.919847 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.11 Aug 09 18:55:13.919847 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABi8qwTxTRax9aM0ufQ6Q5l8qgQyMt3EtdYUWO5UjCOxGNgQXIBQ5Gxp-muP_1Q_xy2PVo5H08NH2UqSuyAxgsy9aQYlZC01UkMmzbB3YAhmACqsz02Vu3RHXME3Cgna9lsgPvOKBV_NUzwEFFxtx4Inz6Hxl2HtBb9lm8w16Hp8d9b2Zc Aug 09 18:55:13.919847 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Aug 09 18:55:13.919847 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Aug 09 18:55:13.919847 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Aug 09 18:55:13.919847 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Aug 09 18:55:13.919847 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Aug 09 18:55:13.919847 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Aug 09 18:55:13.919847 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Id: 4d8f60ca836d43399989fb32ad78d27d Aug 09 18:55:13.919847 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-AttachVolumeTestJSON-1718242744 Aug 09 18:55:13.919847 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Role: reader,member Aug 09 18:55:13.919847 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Roles: reader,member Aug 09 18:55:13.921499 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4d8f60ca836d43399989fb32ad78d27d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4d8f60ca836d43399989fb32ad78d27d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4d8f60ca836d43399989fb32ad78d27d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4d8f60ca836d43399989fb32ad78d27d"}]}] Aug 09 18:55:13.921499 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-AttachVolumeTestJSON-1718242744 Aug 09 18:55:13.921499 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 4d8f60ca836d43399989fb32ad78d27d Aug 09 18:55:13.921499 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1718242744 Aug 09 18:55:13.921499 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User: tempest-AttachVolumeTestJSON-1718242744-project Aug 09 18:55:13.921499 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Aug 09 18:55:13.921499 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Aug 09 18:55:13.921499 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Id: a6e48ee30c61424ba0c82ac4fc5cd06c Aug 09 18:55:13.921499 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-AttachVolumeTestJSON-1718242744-project Aug 09 18:55:13.921499 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: method: > Aug 09 18:55:13.921499 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: exception: Instance ece2efc3-8ca5-4b96-93cb-42f4065610c6 could not be found. Aug 09 18:55:13.921499 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: action_args: {'id': 'ece2efc3-8ca5-4b96-93cb-42f4065610c6'} Aug 09 18:55:13.922965 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:55:13.922965 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:55:13.922965 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:55:13.922965 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:55:13.922965 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:55:13.922965 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:55:13.922965 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:55:13.922965 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:55:13.922965 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:55:13.922965 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:55:13.922965 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ece2efc3-8ca5-4b96-93cb-42f4065610c6 could not be found. Aug 09 18:55:13.922965 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:55:13.922965 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:55:13.922965 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:55:13.922965 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:55:13.922965 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:55:13.922965 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:55:13.922965 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:55:13.922965 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:55:13.922965 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:55:13.924524 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:55:13.924524 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:55:13.924524 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:55:13.924524 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:55:13.924524 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:55:13.924524 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:55:13.924524 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:55:13.924524 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ece2efc3-8ca5-4b96-93cb-42f4065610c6 could not be found. Aug 09 18:55:13.924524 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:55:13.924524 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:55:13.924524 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:55:13.924524 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:55:13.924524 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:55:13.924524 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:55:13.924524 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:55:13.924524 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:55:13.924524 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ece2efc3-8ca5-4b96-93cb-42f4065610c6 could not be found. Aug 09 18:55:13.924524 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:55:13.925863 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-eee02b15-525e-4984-a64e-1a640d7518ca tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Returning 404 to user: Instance ece2efc3-8ca5-4b96-93cb-42f4065610c6 could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:55:13.925863 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-eee02b15-525e-4984-a64e-1a640d7518ca tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6" status: 404 len: 111 microversion: 2.1 time: 0.031370 Aug 09 18:55:13.925863 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 405/782] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:55:13 2022] GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:55:13.931353 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-28068c38-f9ea-4192-9070-8bc2a9e48804 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '.version_select at 0x7f8d69c604c0>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:14.031782 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-28068c38-f9ea-4192-9070-8bc2a9e48804 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1892100696" status: 202 len: 0 microversion: 2.1 time: 0.103924 Aug 09 18:55:14.032408 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 378/783] 10.222.0.57 () {58 vars in 1221 bytes} [Tue Aug 9 18:55:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1892100696 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:55:14.588285 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-393f7cbd-2b9c-4c50-a9d0-dd6562c11f97 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:14.588901 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-393f7cbd-2b9c-4c50-a9d0-dd6562c11f97 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: f349cf3d-5117-4617-ad83-8c0cc44f5bd5] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:14.595962 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-393f7cbd-2b9c-4c50-a9d0-dd6562c11f97 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:14.596560 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-393f7cbd-2b9c-4c50-a9d0-dd6562c11f97 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:14.597252 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-393f7cbd-2b9c-4c50-a9d0-dd6562c11f97 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:14.598262 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-393f7cbd-2b9c-4c50-a9d0-dd6562c11f97 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:14.598869 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-393f7cbd-2b9c-4c50-a9d0-dd6562c11f97 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:14.599365 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-393f7cbd-2b9c-4c50-a9d0-dd6562c11f97 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:14.795793 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-393f7cbd-2b9c-4c50-a9d0-dd6562c11f97 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:14.807312 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-393f7cbd-2b9c-4c50-a9d0-dd6562c11f97 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5" status: 200 len: 1366 microversion: 2.1 time: 0.222595 Aug 09 18:55:14.809792 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 406/784] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:55:14 2022] GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:55:15.830567 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-96fae333-bb4e-4f2e-819b-abdfde88960a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:15.831257 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-96fae333-bb4e-4f2e-819b-abdfde88960a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: f349cf3d-5117-4617-ad83-8c0cc44f5bd5] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:15.837583 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-96fae333-bb4e-4f2e-819b-abdfde88960a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:15.838081 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-96fae333-bb4e-4f2e-819b-abdfde88960a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:15.838508 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-96fae333-bb4e-4f2e-819b-abdfde88960a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:15.839207 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-96fae333-bb4e-4f2e-819b-abdfde88960a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:15.839676 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-96fae333-bb4e-4f2e-819b-abdfde88960a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:15.840076 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-96fae333-bb4e-4f2e-819b-abdfde88960a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:15.977612 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-96fae333-bb4e-4f2e-819b-abdfde88960a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:15.986445 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-96fae333-bb4e-4f2e-819b-abdfde88960a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5" status: 200 len: 1556 microversion: 2.1 time: 0.160008 Aug 09 18:55:15.987238 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 379/785] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:55:15 2022] GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5 => generated 1556 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:55:16.007106 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-074ecdf0-e06a-40f8-a284-6a2d43b3eecd tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:16.007700 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-074ecdf0-e06a-40f8-a284-6a2d43b3eecd tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: f349cf3d-5117-4617-ad83-8c0cc44f5bd5] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:16.013799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-074ecdf0-e06a-40f8-a284-6a2d43b3eecd tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:16.014300 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-074ecdf0-e06a-40f8-a284-6a2d43b3eecd tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:16.014742 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-074ecdf0-e06a-40f8-a284-6a2d43b3eecd tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:16.016584 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-074ecdf0-e06a-40f8-a284-6a2d43b3eecd tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:16.017401 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-074ecdf0-e06a-40f8-a284-6a2d43b3eecd tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:16.018008 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-074ecdf0-e06a-40f8-a284-6a2d43b3eecd tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:16.103953 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-074ecdf0-e06a-40f8-a284-6a2d43b3eecd tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100670 Aug 09 18:55:16.104675 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 407/786] 10.222.0.57 () {58 vars in 1275 bytes} [Tue Aug 9 18:55:16 2022] GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:55:17.266871 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-5e3b9616-89cd-4f71-bb81-f29536860a14 req-7458fa74-f40a-4e70-8c8c-ec35343222dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f349cf3d-5117-4617-ad83-8c0cc44f5bd5", "tag": "7c846f90-8370-4cf7-affb-6469e7219d6f"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:55:17.277086 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-5e3b9616-89cd-4f71-bb81-f29536860a14 req-7458fa74-f40a-4e70-8c8c-ec35343222dd service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:17.277585 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-5e3b9616-89cd-4f71-bb81-f29536860a14 req-7458fa74-f40a-4e70-8c8c-ec35343222dd service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:17.278017 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-5e3b9616-89cd-4f71-bb81-f29536860a14 req-7458fa74-f40a-4e70-8c8c-ec35343222dd service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:17.290579 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-5e3b9616-89cd-4f71-bb81-f29536860a14 req-7458fa74-f40a-4e70-8c8c-ec35343222dd service nova] Creating event network-changed:7c846f90-8370-4cf7-affb-6469e7219d6f for instance f349cf3d-5117-4617-ad83-8c0cc44f5bd5 on hv-cinder-82660 Aug 09 18:55:17.295524 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-5e3b9616-89cd-4f71-bb81-f29536860a14 req-7458fa74-f40a-4e70-8c8c-ec35343222dd service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157891 Aug 09 18:55:17.296128 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 380/787] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:55:17.489240 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-71cbbe22-9f24-4076-860d-f4634da6b875 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:17.490540 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-71cbbe22-9f24-4076-860d-f4634da6b875 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ece2efc3-8ca5-4b96-93cb-42f4065610c6] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:17.496724 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-71cbbe22-9f24-4076-860d-f4634da6b875 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:17.497286 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-71cbbe22-9f24-4076-860d-f4634da6b875 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:17.497816 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-71cbbe22-9f24-4076-860d-f4634da6b875 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:17.498583 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-71cbbe22-9f24-4076-860d-f4634da6b875 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:17.499106 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-71cbbe22-9f24-4076-860d-f4634da6b875 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:17.499591 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-71cbbe22-9f24-4076-860d-f4634da6b875 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:17.514288 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-71cbbe22-9f24-4076-860d-f4634da6b875 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] HTTP exception thrown: Instance ece2efc3-8ca5-4b96-93cb-42f4065610c6 could not be found. Aug 09 18:55:17.516512 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-71cbbe22-9f24-4076-860d-f4634da6b875 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Request method failure captured: Aug 09 18:55:17.516512 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: request: DELETE /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6 HTTP/1.1 Aug 09 18:55:17.516512 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept: application/json Aug 09 18:55:17.516512 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Aug 09 18:55:17.516512 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Connection: close Aug 09 18:55:17.516512 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Length: 0 Aug 09 18:55:17.516512 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Type: application/json Aug 09 18:55:17.516512 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Host: 10.222.0.57 Aug 09 18:55:17.516512 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Aug 09 18:55:17.516512 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.11 Aug 09 18:55:17.516512 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABi8qwTxTRax9aM0ufQ6Q5l8qgQyMt3EtdYUWO5UjCOxGNgQXIBQ5Gxp-muP_1Q_xy2PVo5H08NH2UqSuyAxgsy9aQYlZC01UkMmzbB3YAhmACqsz02Vu3RHXME3Cgna9lsgPvOKBV_NUzwEFFxtx4Inz6Hxl2HtBb9lm8w16Hp8d9b2Zc Aug 09 18:55:17.516512 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Aug 09 18:55:17.516512 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Aug 09 18:55:17.516512 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Aug 09 18:55:17.516512 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Aug 09 18:55:17.516512 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Aug 09 18:55:17.516512 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Aug 09 18:55:17.516512 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Id: 4d8f60ca836d43399989fb32ad78d27d Aug 09 18:55:17.516512 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-AttachVolumeTestJSON-1718242744 Aug 09 18:55:17.516512 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Role: reader,member Aug 09 18:55:17.516512 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Roles: reader,member Aug 09 18:55:17.517944 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4d8f60ca836d43399989fb32ad78d27d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4d8f60ca836d43399989fb32ad78d27d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4d8f60ca836d43399989fb32ad78d27d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4d8f60ca836d43399989fb32ad78d27d"}]}] Aug 09 18:55:17.517944 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-AttachVolumeTestJSON-1718242744 Aug 09 18:55:17.517944 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 4d8f60ca836d43399989fb32ad78d27d Aug 09 18:55:17.517944 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1718242744 Aug 09 18:55:17.517944 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User: tempest-AttachVolumeTestJSON-1718242744-project Aug 09 18:55:17.517944 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Aug 09 18:55:17.517944 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Aug 09 18:55:17.517944 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Id: a6e48ee30c61424ba0c82ac4fc5cd06c Aug 09 18:55:17.517944 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-AttachVolumeTestJSON-1718242744-project Aug 09 18:55:17.517944 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: method: > Aug 09 18:55:17.517944 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: exception: Instance ece2efc3-8ca5-4b96-93cb-42f4065610c6 could not be found. Aug 09 18:55:17.517944 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: action_args: {'id': 'ece2efc3-8ca5-4b96-93cb-42f4065610c6'} Aug 09 18:55:17.518719 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:55:17.518719 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:55:17.518719 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:55:17.518719 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:55:17.518719 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:55:17.518719 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:55:17.518719 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:55:17.518719 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:55:17.518719 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:55:17.518719 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:55:17.518719 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ece2efc3-8ca5-4b96-93cb-42f4065610c6 could not be found. Aug 09 18:55:17.518719 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:55:17.518719 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:55:17.518719 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:55:17.518719 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:55:17.518719 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:55:17.518719 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:55:17.518719 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:55:17.518719 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:55:17.518719 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:55:17.519955 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:55:17.519955 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 18:55:17.519955 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 18:55:17.519955 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 18:55:17.519955 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 18:55:17.519955 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:55:17.519955 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:55:17.519955 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:55:17.519955 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:55:17.519955 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ece2efc3-8ca5-4b96-93cb-42f4065610c6 could not be found. Aug 09 18:55:17.519955 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:55:17.519955 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:55:17.519955 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:55:17.519955 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:55:17.519955 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:55:17.519955 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:55:17.519955 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:55:17.519955 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:55:17.519955 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ece2efc3-8ca5-4b96-93cb-42f4065610c6 could not be found. Aug 09 18:55:17.519955 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:55:17.521233 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-71cbbe22-9f24-4076-860d-f4634da6b875 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Returning 404 to user: Instance ece2efc3-8ca5-4b96-93cb-42f4065610c6 could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:55:17.521920 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-71cbbe22-9f24-4076-860d-f4634da6b875 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6" status: 404 len: 111 microversion: 2.1 time: 0.037902 Aug 09 18:55:17.523235 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 408/788] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 9 18:55:17 2022] DELETE /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:55:17.532534 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-f265651d-0bcd-4353-a6ad-84aeec090f1d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:17.533243 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-f265651d-0bcd-4353-a6ad-84aeec090f1d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ece2efc3-8ca5-4b96-93cb-42f4065610c6] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:17.539886 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f265651d-0bcd-4353-a6ad-84aeec090f1d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:17.540385 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f265651d-0bcd-4353-a6ad-84aeec090f1d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:17.540818 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f265651d-0bcd-4353-a6ad-84aeec090f1d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:17.541552 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f265651d-0bcd-4353-a6ad-84aeec090f1d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:17.542015 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f265651d-0bcd-4353-a6ad-84aeec090f1d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:17.542445 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f265651d-0bcd-4353-a6ad-84aeec090f1d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:17.559424 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.wsgi [None req-f265651d-0bcd-4353-a6ad-84aeec090f1d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] HTTP exception thrown: Instance ece2efc3-8ca5-4b96-93cb-42f4065610c6 could not be found. Aug 09 18:55:17.561182 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-f265651d-0bcd-4353-a6ad-84aeec090f1d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Request method failure captured: Aug 09 18:55:17.561182 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: request: GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6 HTTP/1.1 Aug 09 18:55:17.561182 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept: application/json Aug 09 18:55:17.561182 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept-Encoding: identity Aug 09 18:55:17.561182 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Connection: close Aug 09 18:55:17.561182 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Length: 0 Aug 09 18:55:17.561182 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Type: application/json Aug 09 18:55:17.561182 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Host: 10.222.0.57 Aug 09 18:55:17.561182 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Openstack-System-Scope: None Aug 09 18:55:17.561182 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: User-Agent: python-urllib3/1.26.11 Aug 09 18:55:17.561182 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Auth-Token: gAAAAABi8qwTxTRax9aM0ufQ6Q5l8qgQyMt3EtdYUWO5UjCOxGNgQXIBQ5Gxp-muP_1Q_xy2PVo5H08NH2UqSuyAxgsy9aQYlZC01UkMmzbB3YAhmACqsz02Vu3RHXME3Cgna9lsgPvOKBV_NUzwEFFxtx4Inz6Hxl2HtBb9lm8w16Hp8d9b2Zc Aug 09 18:55:17.561182 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Id: None Aug 09 18:55:17.561182 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Name: None Aug 09 18:55:17.561182 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Identity-Status: Confirmed Aug 09 18:55:17.561182 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Is-Admin-Project: True Aug 09 18:55:17.561182 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Id: default Aug 09 18:55:17.561182 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Name: Default Aug 09 18:55:17.561182 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Id: 4d8f60ca836d43399989fb32ad78d27d Aug 09 18:55:17.561182 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Name: tempest-AttachVolumeTestJSON-1718242744 Aug 09 18:55:17.561182 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Role: reader,member Aug 09 18:55:17.561182 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Roles: reader,member Aug 09 18:55:17.562768 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4d8f60ca836d43399989fb32ad78d27d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4d8f60ca836d43399989fb32ad78d27d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4d8f60ca836d43399989fb32ad78d27d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4d8f60ca836d43399989fb32ad78d27d"}]}] Aug 09 18:55:17.562768 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant: tempest-AttachVolumeTestJSON-1718242744 Aug 09 18:55:17.562768 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Id: 4d8f60ca836d43399989fb32ad78d27d Aug 09 18:55:17.562768 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1718242744 Aug 09 18:55:17.562768 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User: tempest-AttachVolumeTestJSON-1718242744-project Aug 09 18:55:17.562768 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Id: default Aug 09 18:55:17.562768 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Name: Default Aug 09 18:55:17.562768 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Id: a6e48ee30c61424ba0c82ac4fc5cd06c Aug 09 18:55:17.562768 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Name: tempest-AttachVolumeTestJSON-1718242744-project Aug 09 18:55:17.562768 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: method: > Aug 09 18:55:17.562768 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: exception: Instance ece2efc3-8ca5-4b96-93cb-42f4065610c6 could not be found. Aug 09 18:55:17.562768 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: action_args: {'id': 'ece2efc3-8ca5-4b96-93cb-42f4065610c6'} Aug 09 18:55:17.563517 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:55:17.563517 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:55:17.563517 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:55:17.563517 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:55:17.563517 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:55:17.563517 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:55:17.563517 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:55:17.563517 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:55:17.563517 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:55:17.563517 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:55:17.563517 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ece2efc3-8ca5-4b96-93cb-42f4065610c6 could not be found. Aug 09 18:55:17.563517 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:55:17.563517 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:55:17.563517 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:55:17.563517 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:55:17.563517 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:55:17.563517 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:55:17.563517 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:55:17.563517 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:55:17.563517 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:55:17.564741 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:55:17.564741 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:55:17.564741 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:55:17.564741 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:55:17.564741 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:55:17.564741 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:55:17.564741 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:55:17.564741 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ece2efc3-8ca5-4b96-93cb-42f4065610c6 could not be found. Aug 09 18:55:17.564741 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:55:17.564741 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:55:17.564741 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:55:17.564741 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:55:17.564741 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:55:17.564741 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:55:17.564741 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:55:17.564741 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:55:17.564741 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ece2efc3-8ca5-4b96-93cb-42f4065610c6 could not be found. Aug 09 18:55:17.564741 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:55:17.567217 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-f265651d-0bcd-4353-a6ad-84aeec090f1d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Returning 404 to user: Instance ece2efc3-8ca5-4b96-93cb-42f4065610c6 could not be found. {{(pid=124726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:55:17.567217 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-f265651d-0bcd-4353-a6ad-84aeec090f1d tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6" status: 404 len: 111 microversion: 2.1 time: 0.034912 Aug 09 18:55:17.567217 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 381/789] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:55:17 2022] GET /compute/v2.1/servers/ece2efc3-8ca5-4b96-93cb-42f4065610c6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:55:18.856081 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b85421e6-0ada-4067-bdcc-58f890c1fdc6 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:18.856565 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-b85421e6-0ada-4067-bdcc-58f890c1fdc6 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:18.863517 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b85421e6-0ada-4067-bdcc-58f890c1fdc6 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:18.864006 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b85421e6-0ada-4067-bdcc-58f890c1fdc6 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:18.864420 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b85421e6-0ada-4067-bdcc-58f890c1fdc6 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:18.865103 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b85421e6-0ada-4067-bdcc-58f890c1fdc6 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:18.865571 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b85421e6-0ada-4067-bdcc-58f890c1fdc6 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:18.866000 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b85421e6-0ada-4067-bdcc-58f890c1fdc6 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:18.879775 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-b85421e6-0ada-4067-bdcc-58f890c1fdc6 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] HTTP exception thrown: Instance ec125ee9-c66e-4b3d-9304-ef14211241af could not be found. Aug 09 18:55:18.881381 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b85421e6-0ada-4067-bdcc-58f890c1fdc6 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Request method failure captured: Aug 09 18:55:18.881381 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: request: DELETE /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af HTTP/1.1 Aug 09 18:55:18.881381 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept: application/json Aug 09 18:55:18.881381 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Aug 09 18:55:18.881381 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Connection: close Aug 09 18:55:18.881381 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Length: 0 Aug 09 18:55:18.881381 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Type: application/json Aug 09 18:55:18.881381 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Host: 10.222.0.57 Aug 09 18:55:18.881381 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Aug 09 18:55:18.881381 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.11 Aug 09 18:55:18.881381 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABi8qwTxTRax9aM0ufQ6Q5l8qgQyMt3EtdYUWO5UjCOxGNgQXIBQ5Gxp-muP_1Q_xy2PVo5H08NH2UqSuyAxgsy9aQYlZC01UkMmzbB3YAhmACqsz02Vu3RHXME3Cgna9lsgPvOKBV_NUzwEFFxtx4Inz6Hxl2HtBb9lm8w16Hp8d9b2Zc Aug 09 18:55:18.881381 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Aug 09 18:55:18.881381 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Aug 09 18:55:18.881381 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Aug 09 18:55:18.881381 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Aug 09 18:55:18.881381 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Aug 09 18:55:18.881381 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Aug 09 18:55:18.881381 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Id: 4d8f60ca836d43399989fb32ad78d27d Aug 09 18:55:18.881381 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-AttachVolumeTestJSON-1718242744 Aug 09 18:55:18.881381 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Role: reader,member Aug 09 18:55:18.881381 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Roles: reader,member Aug 09 18:55:18.883127 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4d8f60ca836d43399989fb32ad78d27d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4d8f60ca836d43399989fb32ad78d27d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4d8f60ca836d43399989fb32ad78d27d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4d8f60ca836d43399989fb32ad78d27d"}]}] Aug 09 18:55:18.883127 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-AttachVolumeTestJSON-1718242744 Aug 09 18:55:18.883127 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 4d8f60ca836d43399989fb32ad78d27d Aug 09 18:55:18.883127 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1718242744 Aug 09 18:55:18.883127 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User: tempest-AttachVolumeTestJSON-1718242744-project Aug 09 18:55:18.883127 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Aug 09 18:55:18.883127 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Aug 09 18:55:18.883127 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Id: a6e48ee30c61424ba0c82ac4fc5cd06c Aug 09 18:55:18.883127 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-AttachVolumeTestJSON-1718242744-project Aug 09 18:55:18.883127 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: method: > Aug 09 18:55:18.883127 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: exception: Instance ec125ee9-c66e-4b3d-9304-ef14211241af could not be found. Aug 09 18:55:18.883127 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: action_args: {'id': 'ec125ee9-c66e-4b3d-9304-ef14211241af'} Aug 09 18:55:18.884284 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:55:18.884284 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:55:18.884284 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:55:18.884284 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:55:18.884284 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:55:18.884284 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:55:18.884284 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:55:18.884284 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:55:18.884284 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:55:18.884284 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:55:18.884284 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec125ee9-c66e-4b3d-9304-ef14211241af could not be found. Aug 09 18:55:18.884284 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:55:18.884284 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:55:18.884284 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:55:18.884284 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:55:18.884284 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:55:18.884284 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:55:18.884284 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:55:18.884284 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:55:18.884284 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:55:18.885773 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:55:18.885773 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 18:55:18.885773 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 18:55:18.885773 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 18:55:18.885773 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 18:55:18.885773 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:55:18.885773 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:55:18.885773 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:55:18.885773 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:55:18.885773 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec125ee9-c66e-4b3d-9304-ef14211241af could not be found. Aug 09 18:55:18.885773 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:55:18.885773 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:55:18.885773 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:55:18.885773 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:55:18.885773 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:55:18.885773 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:55:18.885773 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:55:18.885773 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:55:18.885773 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec125ee9-c66e-4b3d-9304-ef14211241af could not be found. Aug 09 18:55:18.885773 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:55:18.887527 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b85421e6-0ada-4067-bdcc-58f890c1fdc6 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Returning 404 to user: Instance ec125ee9-c66e-4b3d-9304-ef14211241af could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:55:18.887527 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-b85421e6-0ada-4067-bdcc-58f890c1fdc6 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 404 len: 111 microversion: 2.1 time: 0.030570 Aug 09 18:55:18.887527 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 409/790] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 9 18:55:18 2022] DELETE /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:55:18.891151 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-52e67867-ca2d-48df-b853-59aff9cbcb25 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:18.891761 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-52e67867-ca2d-48df-b853-59aff9cbcb25 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] [instance: ec125ee9-c66e-4b3d-9304-ef14211241af] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:18.898338 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-52e67867-ca2d-48df-b853-59aff9cbcb25 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:18.898817 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-52e67867-ca2d-48df-b853-59aff9cbcb25 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:18.899252 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-52e67867-ca2d-48df-b853-59aff9cbcb25 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:18.899939 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-52e67867-ca2d-48df-b853-59aff9cbcb25 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:18.900392 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-52e67867-ca2d-48df-b853-59aff9cbcb25 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:18.900812 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-52e67867-ca2d-48df-b853-59aff9cbcb25 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:18.905096 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell1:SELECT=100 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:55:18.916785 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.wsgi [None req-52e67867-ca2d-48df-b853-59aff9cbcb25 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] HTTP exception thrown: Instance ec125ee9-c66e-4b3d-9304-ef14211241af could not be found. Aug 09 18:55:18.918423 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-52e67867-ca2d-48df-b853-59aff9cbcb25 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Request method failure captured: Aug 09 18:55:18.918423 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: request: GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af HTTP/1.1 Aug 09 18:55:18.918423 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept: application/json Aug 09 18:55:18.918423 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept-Encoding: identity Aug 09 18:55:18.918423 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Connection: close Aug 09 18:55:18.918423 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Length: 0 Aug 09 18:55:18.918423 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Type: application/json Aug 09 18:55:18.918423 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Host: 10.222.0.57 Aug 09 18:55:18.918423 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Openstack-System-Scope: None Aug 09 18:55:18.918423 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: User-Agent: python-urllib3/1.26.11 Aug 09 18:55:18.918423 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Auth-Token: gAAAAABi8qwTxTRax9aM0ufQ6Q5l8qgQyMt3EtdYUWO5UjCOxGNgQXIBQ5Gxp-muP_1Q_xy2PVo5H08NH2UqSuyAxgsy9aQYlZC01UkMmzbB3YAhmACqsz02Vu3RHXME3Cgna9lsgPvOKBV_NUzwEFFxtx4Inz6Hxl2HtBb9lm8w16Hp8d9b2Zc Aug 09 18:55:18.918423 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Id: None Aug 09 18:55:18.918423 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Name: None Aug 09 18:55:18.918423 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Identity-Status: Confirmed Aug 09 18:55:18.918423 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Is-Admin-Project: True Aug 09 18:55:18.918423 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Id: default Aug 09 18:55:18.918423 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Name: Default Aug 09 18:55:18.918423 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Id: 4d8f60ca836d43399989fb32ad78d27d Aug 09 18:55:18.918423 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Name: tempest-AttachVolumeTestJSON-1718242744 Aug 09 18:55:18.918423 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Role: reader,member Aug 09 18:55:18.918423 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Roles: reader,member Aug 09 18:55:18.920038 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4d8f60ca836d43399989fb32ad78d27d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4d8f60ca836d43399989fb32ad78d27d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4d8f60ca836d43399989fb32ad78d27d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4d8f60ca836d43399989fb32ad78d27d"}]}] Aug 09 18:55:18.920038 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant: tempest-AttachVolumeTestJSON-1718242744 Aug 09 18:55:18.920038 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Id: 4d8f60ca836d43399989fb32ad78d27d Aug 09 18:55:18.920038 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1718242744 Aug 09 18:55:18.920038 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User: tempest-AttachVolumeTestJSON-1718242744-project Aug 09 18:55:18.920038 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Id: default Aug 09 18:55:18.920038 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Name: Default Aug 09 18:55:18.920038 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Id: a6e48ee30c61424ba0c82ac4fc5cd06c Aug 09 18:55:18.920038 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Name: tempest-AttachVolumeTestJSON-1718242744-project Aug 09 18:55:18.920038 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: method: > Aug 09 18:55:18.920038 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: exception: Instance ec125ee9-c66e-4b3d-9304-ef14211241af could not be found. Aug 09 18:55:18.920038 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: action_args: {'id': 'ec125ee9-c66e-4b3d-9304-ef14211241af'} Aug 09 18:55:18.921038 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:55:18.921038 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:55:18.921038 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:55:18.921038 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:55:18.921038 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:55:18.921038 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:55:18.921038 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:55:18.921038 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:55:18.921038 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:55:18.921038 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:55:18.921038 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec125ee9-c66e-4b3d-9304-ef14211241af could not be found. Aug 09 18:55:18.921038 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:55:18.921038 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:55:18.921038 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:55:18.921038 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:55:18.921038 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:55:18.921038 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:55:18.921038 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:55:18.921038 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:55:18.921038 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:55:18.922592 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:55:18.922592 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:55:18.922592 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:55:18.922592 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:55:18.922592 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:55:18.922592 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:55:18.922592 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:55:18.922592 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec125ee9-c66e-4b3d-9304-ef14211241af could not be found. Aug 09 18:55:18.922592 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:55:18.922592 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:55:18.922592 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:55:18.922592 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:55:18.922592 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:55:18.922592 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:55:18.922592 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:55:18.922592 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:55:18.922592 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec125ee9-c66e-4b3d-9304-ef14211241af could not be found. Aug 09 18:55:18.922592 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:55:18.924807 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-52e67867-ca2d-48df-b853-59aff9cbcb25 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] Returning 404 to user: Instance ec125ee9-c66e-4b3d-9304-ef14211241af could not be found. {{(pid=124726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:55:18.924807 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-52e67867-ca2d-48df-b853-59aff9cbcb25 tempest-AttachVolumeTestJSON-1718242744 tempest-AttachVolumeTestJSON-1718242744-project] 10.222.0.57 "GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af" status: 404 len: 111 microversion: 2.1 time: 0.032304 Aug 09 18:55:18.924807 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 382/791] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:55:18 2022] GET /compute/v2.1/servers/ec125ee9-c66e-4b3d-9304-ef14211241af => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:55:24.557407 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-8f4513ef-a841-46f2-829b-a257379ff683 tempest-VolumesGetTestJSON-350477712 tempest-VolumesGetTestJSON-350477712-project] Action: 'create', calling method: .version_select at 0x7f8d694b34c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-114770357", "metadata": {"Type": "work"}}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:55:25.341651 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-8f4513ef-a841-46f2-829b-a257379ff683 tempest-VolumesGetTestJSON-350477712 tempest-VolumesGetTestJSON-350477712-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.905559 Aug 09 18:55:25.342713 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 410/792] 10.222.0.57 () {60 vars in 1156 bytes} [Tue Aug 9 18:55:24 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 907 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 09 18:55:25.355645 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-ea58d55a-4db6-40a8-8289-037e3adcfd3b tempest-VolumesGetTestJSON-350477712 tempest-VolumesGetTestJSON-350477712-project] Calling method '.version_select at 0x7f8d69c2dca0>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:25.407321 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-ea58d55a-4db6-40a8-8289-037e3adcfd3b tempest-VolumesGetTestJSON-350477712 tempest-VolumesGetTestJSON-350477712-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/b7a64edd-4782-4702-a489-07a49f16fd9c" status: 200 len: 352 microversion: 2.1 time: 0.055167 Aug 09 18:55:25.407893 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 383/793] 10.222.0.57 () {58 vars in 1245 bytes} [Tue Aug 9 18:55:25 2022] GET /compute/v2.1/os-volumes/b7a64edd-4782-4702-a489-07a49f16fd9c => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:55:26.421540 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f64bbc67-6999-4e0b-bcfe-2586a2d849e4 tempest-VolumesGetTestJSON-350477712 tempest-VolumesGetTestJSON-350477712-project] Calling method '.version_select at 0x7f8d69402430>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:26.485773 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f64bbc67-6999-4e0b-bcfe-2586a2d849e4 tempest-VolumesGetTestJSON-350477712 tempest-VolumesGetTestJSON-350477712-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/b7a64edd-4782-4702-a489-07a49f16fd9c" status: 200 len: 353 microversion: 2.1 time: 0.067837 Aug 09 18:55:26.486350 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 411/794] 10.222.0.57 () {58 vars in 1245 bytes} [Tue Aug 9 18:55:26 2022] GET /compute/v2.1/os-volumes/b7a64edd-4782-4702-a489-07a49f16fd9c => generated 353 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:55:26.499015 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-c407e674-5d00-40d1-bb15-97a10f8f310a tempest-VolumesGetTestJSON-350477712 tempest-VolumesGetTestJSON-350477712-project] Calling method '.version_select at 0x7f8d69bc43a0>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:26.549432 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-c407e674-5d00-40d1-bb15-97a10f8f310a tempest-VolumesGetTestJSON-350477712 tempest-VolumesGetTestJSON-350477712-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/b7a64edd-4782-4702-a489-07a49f16fd9c" status: 200 len: 353 microversion: 2.1 time: 0.054683 Aug 09 18:55:26.550129 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 384/795] 10.222.0.57 () {58 vars in 1245 bytes} [Tue Aug 9 18:55:26 2022] GET /compute/v2.1/os-volumes/b7a64edd-4782-4702-a489-07a49f16fd9c => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:55:26.567743 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f444b2af-2594-41d9-9a16-a30e992cadfd tempest-VolumesGetTestJSON-350477712 tempest-VolumesGetTestJSON-350477712-project] Calling method '.version_select at 0x7f8d6943ec10>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:26.749914 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f444b2af-2594-41d9-9a16-a30e992cadfd tempest-VolumesGetTestJSON-350477712 tempest-VolumesGetTestJSON-350477712-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/b7a64edd-4782-4702-a489-07a49f16fd9c" status: 202 len: 0 microversion: 2.1 time: 0.185942 Aug 09 18:55:26.750482 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 412/796] 10.222.0.57 () {58 vars in 1248 bytes} [Tue Aug 9 18:55:26 2022] DELETE /compute/v2.1/os-volumes/b7a64edd-4782-4702-a489-07a49f16fd9c => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:55:26.759333 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-7aceecd0-a615-480f-8317-28afac8bcd0a tempest-VolumesGetTestJSON-350477712 tempest-VolumesGetTestJSON-350477712-project] Calling method '.version_select at 0x7f8d69bea550>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:26.808456 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-7aceecd0-a615-480f-8317-28afac8bcd0a tempest-VolumesGetTestJSON-350477712 tempest-VolumesGetTestJSON-350477712-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/b7a64edd-4782-4702-a489-07a49f16fd9c" status: 200 len: 352 microversion: 2.1 time: 0.053334 Aug 09 18:55:26.809322 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 385/797] 10.222.0.57 () {58 vars in 1245 bytes} [Tue Aug 9 18:55:26 2022] GET /compute/v2.1/os-volumes/b7a64edd-4782-4702-a489-07a49f16fd9c => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:55:27.822294 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5fcc1a5f-7398-4024-a380-08760ad60d72 tempest-VolumesGetTestJSON-350477712 tempest-VolumesGetTestJSON-350477712-project] Calling method '.version_select at 0x7f8d694baee0>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:27.850357 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-5fcc1a5f-7398-4024-a380-08760ad60d72 tempest-VolumesGetTestJSON-350477712 tempest-VolumesGetTestJSON-350477712-project] HTTP exception thrown: Volume b7a64edd-4782-4702-a489-07a49f16fd9c could not be found. Aug 09 18:55:27.853805 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5fcc1a5f-7398-4024-a380-08760ad60d72 tempest-VolumesGetTestJSON-350477712 tempest-VolumesGetTestJSON-350477712-project] Request method failure captured: Aug 09 18:55:27.853805 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: request: GET /compute/v2.1/os-volumes/b7a64edd-4782-4702-a489-07a49f16fd9c HTTP/1.1 Aug 09 18:55:27.853805 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept: application/json Aug 09 18:55:27.853805 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Aug 09 18:55:27.853805 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Connection: close Aug 09 18:55:27.853805 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Length: 0 Aug 09 18:55:27.853805 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Type: application/json Aug 09 18:55:27.853805 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Host: 10.222.0.57 Aug 09 18:55:27.853805 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Aug 09 18:55:27.853805 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.11 Aug 09 18:55:27.853805 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABi8q2czRQFUW5cIbYjibacU-_JA7h_4W3hK9-luSzkXZ6UBBMLvJYQnTzkkgN_UrdvAm7JLIKykhUCnbqZVlW2Lpqu5u1BrXJ6S6TpGahboCBoSSExLgLjWJZWGcgCAFqjNcWAhMfAgSwL4TtiITHFZu0BkbeNAj1r0-rNij-rMpzR1Ao Aug 09 18:55:27.853805 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Aug 09 18:55:27.853805 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Aug 09 18:55:27.853805 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Aug 09 18:55:27.853805 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Aug 09 18:55:27.853805 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Aug 09 18:55:27.853805 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Aug 09 18:55:27.853805 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Id: 00e6ee96d5d2432abf5dc270727c7493 Aug 09 18:55:27.853805 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-VolumesGetTestJSON-350477712 Aug 09 18:55:27.853805 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Role: reader,member Aug 09 18:55:27.853805 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Roles: reader,member Aug 09 18:55:27.861293 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_00e6ee96d5d2432abf5dc270727c7493", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/00e6ee96d5d2432abf5dc270727c7493"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/00e6ee96d5d2432abf5dc270727c7493"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/00e6ee96d5d2432abf5dc270727c7493"}]}] Aug 09 18:55:27.861293 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-VolumesGetTestJSON-350477712 Aug 09 18:55:27.861293 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 00e6ee96d5d2432abf5dc270727c7493 Aug 09 18:55:27.861293 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-VolumesGetTestJSON-350477712 Aug 09 18:55:27.861293 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User: tempest-VolumesGetTestJSON-350477712-project Aug 09 18:55:27.861293 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Aug 09 18:55:27.861293 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Aug 09 18:55:27.861293 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Id: 8d3f9e6b0b31451f93546fd92de2cf6b Aug 09 18:55:27.861293 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-VolumesGetTestJSON-350477712-project Aug 09 18:55:27.861293 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: method: Aug 09 18:55:27.861293 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: exception: Volume b7a64edd-4782-4702-a489-07a49f16fd9c could not be found. Aug 09 18:55:27.861293 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: action_args: {'id': 'b7a64edd-4782-4702-a489-07a49f16fd9c'} Aug 09 18:55:27.861293 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:55:27.862822 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:55:27.862822 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 18:55:27.862822 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 18:55:27.862822 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 18:55:27.862822 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 18:55:27.862822 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 18:55:27.862822 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 18:55:27.862822 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 18:55:27.862822 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 18:55:27.862822 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 18:55:27.862822 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 18:55:27.862822 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 18:55:27.862822 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 18:55:27.862822 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 18:55:27.862822 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 18:55:27.862822 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b7a64edd-4782-4702-a489-07a49f16fd9c could not be found. (HTTP 404) (Request-ID: req-828d73d8-c95b-47f0-87e7-8a373c446eb6) Aug 09 18:55:27.862822 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:55:27.862822 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:55:27.862822 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:55:27.864325 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:55:27.864325 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 18:55:27.864325 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 18:55:27.864325 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 18:55:27.864325 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 18:55:27.864325 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 18:55:27.864325 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 18:55:27.864325 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 18:55:27.864325 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 18:55:27.864325 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 18:55:27.864325 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 18:55:27.864325 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 18:55:27.864325 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 18:55:27.864325 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 18:55:27.864325 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 18:55:27.864325 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 18:55:27.864325 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 18:55:27.864325 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 18:55:27.864325 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 18:55:27.865737 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 18:55:27.865737 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 18:55:27.865737 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 18:55:27.865737 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 18:55:27.865737 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b7a64edd-4782-4702-a489-07a49f16fd9c could not be found. Aug 09 18:55:27.865737 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:55:27.865737 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:55:27.865737 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:55:27.865737 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:55:27.865737 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:55:27.865737 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:55:27.865737 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:55:27.865737 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:55:27.865737 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 18:55:27.865737 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 18:55:27.865737 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:55:27.865737 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:55:27.865737 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 18:55:27.865737 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:55:27.867255 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b7a64edd-4782-4702-a489-07a49f16fd9c could not be found. Aug 09 18:55:27.867255 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:55:27.867255 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:55:27.867255 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:55:27.867255 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:55:27.867255 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:55:27.867255 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:55:27.867255 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:55:27.867255 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:55:27.867255 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b7a64edd-4782-4702-a489-07a49f16fd9c could not be found. Aug 09 18:55:27.867255 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:55:27.867255 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5fcc1a5f-7398-4024-a380-08760ad60d72 tempest-VolumesGetTestJSON-350477712 tempest-VolumesGetTestJSON-350477712-project] Returning 404 to user: Volume b7a64edd-4782-4702-a489-07a49f16fd9c could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:55:27.867255 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-5fcc1a5f-7398-4024-a380-08760ad60d72 tempest-VolumesGetTestJSON-350477712 tempest-VolumesGetTestJSON-350477712-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/b7a64edd-4782-4702-a489-07a49f16fd9c" status: 404 len: 109 microversion: 2.1 time: 0.037459 Aug 09 18:55:27.867255 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 413/798] 10.222.0.57 () {58 vars in 1245 bytes} [Tue Aug 9 18:55:27 2022] GET /compute/v2.1/os-volumes/b7a64edd-4782-4702-a489-07a49f16fd9c => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:55:40.159536 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:55:40.166636 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-b62ad0fa-dbf5-4b0c-aad5-ad60b80a1228 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:40.166636 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-b62ad0fa-dbf5-4b0c-aad5-ad60b80a1228 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:40.178016 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b62ad0fa-dbf5-4b0c-aad5-ad60b80a1228 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:40.179093 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b62ad0fa-dbf5-4b0c-aad5-ad60b80a1228 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:40.179093 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b62ad0fa-dbf5-4b0c-aad5-ad60b80a1228 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:40.181421 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b62ad0fa-dbf5-4b0c-aad5-ad60b80a1228 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:40.182114 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b62ad0fa-dbf5-4b0c-aad5-ad60b80a1228 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:40.182391 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-616b7f28-cda6-403d-a218-d874edbd8fdd req-676b227b-8466-4662-b730-b42b7680da62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7", "tag": "f4782f09-a0b0-4715-98fa-ea0d74933d8d"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:55:40.183451 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b62ad0fa-dbf5-4b0c-aad5-ad60b80a1228 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:40.188426 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:55:40.192179 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:55:40.207402 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-616b7f28-cda6-403d-a218-d874edbd8fdd req-676b227b-8466-4662-b730-b42b7680da62 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:40.207886 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-616b7f28-cda6-403d-a218-d874edbd8fdd req-676b227b-8466-4662-b730-b42b7680da62 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:40.208308 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-616b7f28-cda6-403d-a218-d874edbd8fdd req-676b227b-8466-4662-b730-b42b7680da62 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:40.227207 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-616b7f28-cda6-403d-a218-d874edbd8fdd req-676b227b-8466-4662-b730-b42b7680da62 service nova] Creating event network-changed:f4782f09-a0b0-4715-98fa-ea0d74933d8d for instance fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 on hv-cinder-82660 Aug 09 18:55:40.228645 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-b62ad0fa-dbf5-4b0c-aad5-ad60b80a1228 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Going to try to terminate instance {{(pid=124726) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:55:40.232968 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-616b7f28-cda6-403d-a218-d874edbd8fdd req-676b227b-8466-4662-b730-b42b7680da62 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054685 Aug 09 18:55:40.234010 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 414/799] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:55:40.540600 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-b62ad0fa-dbf5-4b0c-aad5-ad60b80a1228 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "DELETE /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 204 len: 0 microversion: 2.1 time: 0.382046 Aug 09 18:55:40.545806 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 386/800] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 9 18:55:40 2022] DELETE /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:55:40.551714 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e8ad7ba0-947d-4bb0-9e76-456855eb8b5c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:40.552417 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e8ad7ba0-947d-4bb0-9e76-456855eb8b5c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:40.564673 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e8ad7ba0-947d-4bb0-9e76-456855eb8b5c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:40.566032 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e8ad7ba0-947d-4bb0-9e76-456855eb8b5c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:40.567088 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e8ad7ba0-947d-4bb0-9e76-456855eb8b5c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:40.568377 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e8ad7ba0-947d-4bb0-9e76-456855eb8b5c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:40.569210 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e8ad7ba0-947d-4bb0-9e76-456855eb8b5c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:40.570038 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e8ad7ba0-947d-4bb0-9e76-456855eb8b5c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:40.720836 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e8ad7ba0-947d-4bb0-9e76-456855eb8b5c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:40.730521 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e8ad7ba0-947d-4bb0-9e76-456855eb8b5c tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1567 microversion: 2.1 time: 0.184414 Aug 09 18:55:40.731314 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 415/801] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:55:40 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:55:41.753484 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-a32291f1-702f-4fd2-be08-e155117b82d3 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:41.754334 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-a32291f1-702f-4fd2-be08-e155117b82d3 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:41.761790 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a32291f1-702f-4fd2-be08-e155117b82d3 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:41.762296 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a32291f1-702f-4fd2-be08-e155117b82d3 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:41.762736 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a32291f1-702f-4fd2-be08-e155117b82d3 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:41.763441 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a32291f1-702f-4fd2-be08-e155117b82d3 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:41.764076 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a32291f1-702f-4fd2-be08-e155117b82d3 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:41.764505 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a32291f1-702f-4fd2-be08-e155117b82d3 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:41.915486 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-a32291f1-702f-4fd2-be08-e155117b82d3 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:41.923130 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-a32291f1-702f-4fd2-be08-e155117b82d3 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1567 microversion: 2.1 time: 0.174205 Aug 09 18:55:41.923721 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 387/802] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:55:41 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:55:42.945509 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-ec486949-3ea6-4fc1-8da3-1a6b79542e4a tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:42.949284 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-ec486949-3ea6-4fc1-8da3-1a6b79542e4a tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:42.954061 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ec486949-3ea6-4fc1-8da3-1a6b79542e4a tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:42.955369 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ec486949-3ea6-4fc1-8da3-1a6b79542e4a tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:42.955961 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ec486949-3ea6-4fc1-8da3-1a6b79542e4a tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:42.956668 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ec486949-3ea6-4fc1-8da3-1a6b79542e4a tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:42.957119 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ec486949-3ea6-4fc1-8da3-1a6b79542e4a tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:42.957559 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ec486949-3ea6-4fc1-8da3-1a6b79542e4a tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:43.165900 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-ec486949-3ea6-4fc1-8da3-1a6b79542e4a tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:43.183145 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-ec486949-3ea6-4fc1-8da3-1a6b79542e4a tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1567 microversion: 2.1 time: 0.241833 Aug 09 18:55:43.186765 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 416/803] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:55:42 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1567 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:55:44.207605 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-830f7cea-b910-40da-92cf-61c6ec5d1972 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:44.207987 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-830f7cea-b910-40da-92cf-61c6ec5d1972 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:44.214386 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-830f7cea-b910-40da-92cf-61c6ec5d1972 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:44.215397 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-830f7cea-b910-40da-92cf-61c6ec5d1972 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:44.216032 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-830f7cea-b910-40da-92cf-61c6ec5d1972 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:44.216960 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-830f7cea-b910-40da-92cf-61c6ec5d1972 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:44.217654 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-830f7cea-b910-40da-92cf-61c6ec5d1972 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:44.218285 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-830f7cea-b910-40da-92cf-61c6ec5d1972 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:44.450714 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-830f7cea-b910-40da-92cf-61c6ec5d1972 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:44.459885 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-830f7cea-b910-40da-92cf-61c6ec5d1972 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1567 microversion: 2.1 time: 0.256807 Aug 09 18:55:44.460541 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 388/804] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:55:44 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1567 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:55:45.489565 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5d923a13-4746-4a85-830f-94a4e2d1e637 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:45.489565 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-5d923a13-4746-4a85-830f-94a4e2d1e637 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:45.500173 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5d923a13-4746-4a85-830f-94a4e2d1e637 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:45.500668 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5d923a13-4746-4a85-830f-94a4e2d1e637 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:45.501105 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5d923a13-4746-4a85-830f-94a4e2d1e637 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:45.502384 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5d923a13-4746-4a85-830f-94a4e2d1e637 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:45.502844 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5d923a13-4746-4a85-830f-94a4e2d1e637 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:45.503286 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5d923a13-4746-4a85-830f-94a4e2d1e637 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:45.568831 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-96016b2d-8e60-4596-95d7-617a49b0b1aa req-0ae2a56e-da2f-4bf8-b529-db23540ab490 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7", "name": "network-vif-deleted", "tag": "f4782f09-a0b0-4715-98fa-ea0d74933d8d"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:55:45.582761 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5d923a13-4746-4a85-830f-94a4e2d1e637 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:45.592650 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-96016b2d-8e60-4596-95d7-617a49b0b1aa req-0ae2a56e-da2f-4bf8-b529-db23540ab490 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:45.593610 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-96016b2d-8e60-4596-95d7-617a49b0b1aa req-0ae2a56e-da2f-4bf8-b529-db23540ab490 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:45.594489 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-96016b2d-8e60-4596-95d7-617a49b0b1aa req-0ae2a56e-da2f-4bf8-b529-db23540ab490 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:45.601688 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-5d923a13-4746-4a85-830f-94a4e2d1e637 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1381 microversion: 2.1 time: 0.116739 Aug 09 18:55:45.610281 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 417/805] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:55:45 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1381 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:55:45.611289 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-96016b2d-8e60-4596-95d7-617a49b0b1aa req-0ae2a56e-da2f-4bf8-b529-db23540ab490 service nova] Creating event network-vif-deleted:f4782f09-a0b0-4715-98fa-ea0d74933d8d for instance fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 on hv-cinder-82660 Aug 09 18:55:45.620133 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-96016b2d-8e60-4596-95d7-617a49b0b1aa req-0ae2a56e-da2f-4bf8-b529-db23540ab490 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054808 Aug 09 18:55:45.620844 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 389/806] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:55:46.626894 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-0c7b86e2-c10c-4c70-9144-4784a597b38d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:46.628568 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-0c7b86e2-c10c-4c70-9144-4784a597b38d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:46.634923 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0c7b86e2-c10c-4c70-9144-4784a597b38d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:46.635498 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0c7b86e2-c10c-4c70-9144-4784a597b38d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:46.636168 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0c7b86e2-c10c-4c70-9144-4784a597b38d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:46.637010 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0c7b86e2-c10c-4c70-9144-4784a597b38d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:46.637706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0c7b86e2-c10c-4c70-9144-4784a597b38d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:46.638281 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0c7b86e2-c10c-4c70-9144-4784a597b38d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:46.677445 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0c7b86e2-c10c-4c70-9144-4784a597b38d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:46.677996 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0c7b86e2-c10c-4c70-9144-4784a597b38d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:46.678611 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0c7b86e2-c10c-4c70-9144-4784a597b38d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:46.679195 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.objects.instance [None req-0c7b86e2-c10c-4c70-9144-4784a597b38d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lazy-loading 'fault' on Instance uuid fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 {{(pid=124725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:55:46.734004 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-0c7b86e2-c10c-4c70-9144-4784a597b38d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc285681bd4843028f0fbbbd01ff4adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6efde3fd7658438cad16413a10503384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:46.747615 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-0c7b86e2-c10c-4c70-9144-4784a597b38d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 200 len: 1224 microversion: 2.1 time: 0.125610 Aug 09 18:55:46.748742 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 418/807] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:55:46 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 1224 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:55:47.771559 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-fcf12c71-fc35-4650-ab5e-a5b0a2276a00 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:47.781652 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-fcf12c71-fc35-4650-ab5e-a5b0a2276a00 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] [instance: fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:47.800367 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fcf12c71-fc35-4650-ab5e-a5b0a2276a00 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:47.804002 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fcf12c71-fc35-4650-ab5e-a5b0a2276a00 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:47.804544 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fcf12c71-fc35-4650-ab5e-a5b0a2276a00 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:47.805488 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fcf12c71-fc35-4650-ab5e-a5b0a2276a00 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:47.806140 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fcf12c71-fc35-4650-ab5e-a5b0a2276a00 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:47.806579 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fcf12c71-fc35-4650-ab5e-a5b0a2276a00 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:47.833912 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.wsgi [None req-fcf12c71-fc35-4650-ab5e-a5b0a2276a00 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] HTTP exception thrown: Instance fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 could not be found. Aug 09 18:55:47.835624 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-fcf12c71-fc35-4650-ab5e-a5b0a2276a00 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Request method failure captured: Aug 09 18:55:47.835624 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: request: GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 HTTP/1.1 Aug 09 18:55:47.835624 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept: application/json Aug 09 18:55:47.835624 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept-Encoding: identity Aug 09 18:55:47.835624 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Connection: close Aug 09 18:55:47.835624 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Length: 0 Aug 09 18:55:47.835624 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Type: application/json Aug 09 18:55:47.835624 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Host: 10.222.0.57 Aug 09 18:55:47.835624 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Openstack-System-Scope: None Aug 09 18:55:47.835624 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: User-Agent: python-urllib3/1.26.11 Aug 09 18:55:47.835624 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Auth-Token: gAAAAABi8qxmdvjmW-WuQ6jaGPfQjN7K6CE_y7Lz86BR5bpIYQgV5i6h5zbR8FzjPpYgMlED8VOg709XAPjvRzWoM75tQumGsVSziUHI-fDCGfUFo8nEpyxUVy3xUXLlbO1pt7z0ynztBWpdpkcgXB4xkXUY07rxk7D-O6lmgrplE9gb3WGjAsc Aug 09 18:55:47.835624 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Id: None Aug 09 18:55:47.835624 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Name: None Aug 09 18:55:47.835624 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Identity-Status: Confirmed Aug 09 18:55:47.835624 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Is-Admin-Project: True Aug 09 18:55:47.835624 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Id: default Aug 09 18:55:47.835624 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Name: Default Aug 09 18:55:47.835624 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Id: 6efde3fd7658438cad16413a10503384 Aug 09 18:55:47.835624 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Name: tempest-TestShelveInstance-180284913 Aug 09 18:55:47.835624 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Role: reader,member Aug 09 18:55:47.835624 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Roles: reader,member Aug 09 18:55:47.837289 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_6efde3fd7658438cad16413a10503384", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6efde3fd7658438cad16413a10503384"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/6efde3fd7658438cad16413a10503384"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6efde3fd7658438cad16413a10503384"}]}] Aug 09 18:55:47.837289 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant: tempest-TestShelveInstance-180284913 Aug 09 18:55:47.837289 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Id: 6efde3fd7658438cad16413a10503384 Aug 09 18:55:47.837289 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Name: tempest-TestShelveInstance-180284913 Aug 09 18:55:47.837289 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User: tempest-TestShelveInstance-180284913-project Aug 09 18:55:47.837289 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Id: default Aug 09 18:55:47.837289 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Name: Default Aug 09 18:55:47.837289 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Id: dc285681bd4843028f0fbbbd01ff4adb Aug 09 18:55:47.837289 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Name: tempest-TestShelveInstance-180284913-project Aug 09 18:55:47.837289 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: method: > Aug 09 18:55:47.837289 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: exception: Instance fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 could not be found. Aug 09 18:55:47.837289 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: action_args: {'id': 'fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7'} Aug 09 18:55:47.838223 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:55:47.838223 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:55:47.838223 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:55:47.838223 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:55:47.838223 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:55:47.838223 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:55:47.838223 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:55:47.838223 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:55:47.838223 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:55:47.838223 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:55:47.838223 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 could not be found. Aug 09 18:55:47.838223 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:55:47.838223 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:55:47.838223 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:55:47.838223 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:55:47.838223 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:55:47.838223 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:55:47.838223 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:55:47.838223 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:55:47.838223 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:55:47.839807 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:55:47.839807 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:55:47.839807 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:55:47.839807 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:55:47.839807 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:55:47.839807 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:55:47.839807 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:55:47.839807 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 could not be found. Aug 09 18:55:47.839807 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:55:47.839807 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:55:47.839807 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:55:47.839807 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:55:47.839807 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:55:47.839807 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:55:47.839807 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:55:47.839807 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:55:47.839807 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 could not be found. Aug 09 18:55:47.839807 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:55:47.840940 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-fcf12c71-fc35-4650-ab5e-a5b0a2276a00 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Returning 404 to user: Instance fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 could not be found. {{(pid=124726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:55:47.840940 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-fcf12c71-fc35-4650-ab5e-a5b0a2276a00 tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7" status: 404 len: 111 microversion: 2.1 time: 0.071191 Aug 09 18:55:47.840940 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 390/808] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:55:47 2022] GET /compute/v2.1/servers/fb725a2e-8f6d-4978-ab2d-7652ad0b1ad7 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:55:48.183627 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a3fb93f8-3e91-454c-9296-222f4c31f72d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] Calling method '.version_select at 0x7f8d694610d0>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:48.277440 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-a3fb93f8-3e91-454c-9296-222f4c31f72d tempest-TestShelveInstance-180284913 tempest-TestShelveInstance-180284913-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-328605986" status: 202 len: 0 microversion: 2.1 time: 0.098582 Aug 09 18:55:48.278182 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 419/809] 10.222.0.57 () {58 vars in 1251 bytes} [Tue Aug 9 18:55:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-328605986 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:55:51.171382 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-3bf5397d-ec9f-45cb-9646-ac5410ffb380 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:51.174813 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-3bf5397d-ec9f-45cb-9646-ac5410ffb380 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:51.196537 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3bf5397d-ec9f-45cb-9646-ac5410ffb380 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:51.199554 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3bf5397d-ec9f-45cb-9646-ac5410ffb380 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:51.200895 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3bf5397d-ec9f-45cb-9646-ac5410ffb380 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:51.201906 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3bf5397d-ec9f-45cb-9646-ac5410ffb380 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:51.203472 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3bf5397d-ec9f-45cb-9646-ac5410ffb380 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:51.206250 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3bf5397d-ec9f-45cb-9646-ac5410ffb380 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:51.288764 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-3bf5397d-ec9f-45cb-9646-ac5410ffb380 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.121865 Aug 09 18:55:51.290789 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 391/810] 10.222.0.57 () {60 vars in 1343 bytes} [Tue Aug 9 18:55:51 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631/os-volume_attachments => generated 25 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:55:51.402860 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a07c5196-82ce-4fe6-a4e4-653d44f630aa tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:51.404091 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-a07c5196-82ce-4fe6-a4e4-653d44f630aa tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:51.413510 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a07c5196-82ce-4fe6-a4e4-653d44f630aa tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:51.414274 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a07c5196-82ce-4fe6-a4e4-653d44f630aa tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:51.415091 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a07c5196-82ce-4fe6-a4e4-653d44f630aa tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:51.416528 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a07c5196-82ce-4fe6-a4e4-653d44f630aa tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:51.417188 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a07c5196-82ce-4fe6-a4e4-653d44f630aa tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:51.417832 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a07c5196-82ce-4fe6-a4e4-653d44f630aa tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:51.461080 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-a07c5196-82ce-4fe6-a4e4-653d44f630aa tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Going to try to terminate instance {{(pid=124725) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:55:51.860112 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-a07c5196-82ce-4fe6-a4e4-653d44f630aa tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 204 len: 0 microversion: 2.20 time: 0.460629 Aug 09 18:55:51.861046 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 420/811] 10.222.0.57 () {60 vars in 1280 bytes} [Tue Aug 9 18:55:51 2022] DELETE /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 18:55:51.870554 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-a5788924-0a44-4082-aa53-214ecf287e8c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:51.871362 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-a5788924-0a44-4082-aa53-214ecf287e8c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:51.893255 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a5788924-0a44-4082-aa53-214ecf287e8c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:51.894176 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a5788924-0a44-4082-aa53-214ecf287e8c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:51.901674 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a5788924-0a44-4082-aa53-214ecf287e8c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:51.905398 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a5788924-0a44-4082-aa53-214ecf287e8c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:51.909758 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a5788924-0a44-4082-aa53-214ecf287e8c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:51.910287 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a5788924-0a44-4082-aa53-214ecf287e8c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:52.189767 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-a5788924-0a44-4082-aa53-214ecf287e8c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:52.200701 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-a5788924-0a44-4082-aa53-214ecf287e8c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:52.205080 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-a5788924-0a44-4082-aa53-214ecf287e8c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:52.206421 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-a5788924-0a44-4082-aa53-214ecf287e8c tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1723 microversion: 2.20 time: 0.340681 Aug 09 18:55:52.207343 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 392/812] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:55:51 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1723 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:55:53.229923 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-031f59cd-e341-4095-b884-b18155105fd3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:53.230747 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-031f59cd-e341-4095-b884-b18155105fd3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:53.245261 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-031f59cd-e341-4095-b884-b18155105fd3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:53.245261 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-031f59cd-e341-4095-b884-b18155105fd3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:53.245261 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-031f59cd-e341-4095-b884-b18155105fd3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:53.245261 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-031f59cd-e341-4095-b884-b18155105fd3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:53.247203 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-031f59cd-e341-4095-b884-b18155105fd3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:53.247877 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-031f59cd-e341-4095-b884-b18155105fd3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:53.565043 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-031f59cd-e341-4095-b884-b18155105fd3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:53.576354 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-031f59cd-e341-4095-b884-b18155105fd3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:53.580282 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-031f59cd-e341-4095-b884-b18155105fd3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:53.586099 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-031f59cd-e341-4095-b884-b18155105fd3 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1723 microversion: 2.20 time: 0.358974 Aug 09 18:55:53.587105 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 421/813] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:55:53 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1723 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:55:54.611201 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-0b11773d-bb24-4a70-8b75-b239e18e864d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:54.612438 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-0b11773d-bb24-4a70-8b75-b239e18e864d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:54.628798 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0b11773d-bb24-4a70-8b75-b239e18e864d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:54.628952 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0b11773d-bb24-4a70-8b75-b239e18e864d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:54.629318 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0b11773d-bb24-4a70-8b75-b239e18e864d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:54.630073 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0b11773d-bb24-4a70-8b75-b239e18e864d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:54.630531 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0b11773d-bb24-4a70-8b75-b239e18e864d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:54.630952 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0b11773d-bb24-4a70-8b75-b239e18e864d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:54.851936 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-0b11773d-bb24-4a70-8b75-b239e18e864d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:54.869864 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-0b11773d-bb24-4a70-8b75-b239e18e864d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:54.872595 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-0b11773d-bb24-4a70-8b75-b239e18e864d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef8af9fd9e844ca4be10caa880357a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d738e0a61184b4db58e2607d72cca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:55:54.874060 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-0b11773d-bb24-4a70-8b75-b239e18e864d tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 200 len: 1655 microversion: 2.20 time: 0.267261 Aug 09 18:55:54.876021 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 393/814] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:55:54 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 1655 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:55:55.116488 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-c4322930-baff-497f-b73d-8a43d15b8dd1 req-4f72e8b8-42e5-431a-b58d-9e15c5bc1ada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f84c5e3-7213-4bd2-ad7c-4794aab9d631", "name": "network-vif-deleted", "tag": "d2e3768b-d787-45b4-941d-9253bd20d687"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:55:55.146384 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-c4322930-baff-497f-b73d-8a43d15b8dd1 req-4f72e8b8-42e5-431a-b58d-9e15c5bc1ada service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:55.149501 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-c4322930-baff-497f-b73d-8a43d15b8dd1 req-4f72e8b8-42e5-431a-b58d-9e15c5bc1ada service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:55.155109 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-c4322930-baff-497f-b73d-8a43d15b8dd1 req-4f72e8b8-42e5-431a-b58d-9e15c5bc1ada service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:55.177113 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-c4322930-baff-497f-b73d-8a43d15b8dd1 req-4f72e8b8-42e5-431a-b58d-9e15c5bc1ada service nova] Creating event network-vif-deleted:d2e3768b-d787-45b4-941d-9253bd20d687 for instance 8f84c5e3-7213-4bd2-ad7c-4794aab9d631 on hv-cinder-82660 Aug 09 18:55:55.192687 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-c4322930-baff-497f-b73d-8a43d15b8dd1 req-4f72e8b8-42e5-431a-b58d-9e15c5bc1ada service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079653 Aug 09 18:55:55.193607 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 422/815] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:55:55.898952 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-733a4852-3421-4a87-b9f8-f5d0bdabb831 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:55.899640 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-733a4852-3421-4a87-b9f8-f5d0bdabb831 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:55.913028 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-733a4852-3421-4a87-b9f8-f5d0bdabb831 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:55.913609 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-733a4852-3421-4a87-b9f8-f5d0bdabb831 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:55.913982 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-733a4852-3421-4a87-b9f8-f5d0bdabb831 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:55.923094 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-733a4852-3421-4a87-b9f8-f5d0bdabb831 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:55.924095 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-733a4852-3421-4a87-b9f8-f5d0bdabb831 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:55.924548 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-733a4852-3421-4a87-b9f8-f5d0bdabb831 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:55.966336 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.wsgi [None req-733a4852-3421-4a87-b9f8-f5d0bdabb831 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] HTTP exception thrown: Instance 8f84c5e3-7213-4bd2-ad7c-4794aab9d631 could not be found. Aug 09 18:55:55.979914 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-733a4852-3421-4a87-b9f8-f5d0bdabb831 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Request method failure captured: Aug 09 18:55:55.979914 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: request: GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 HTTP/1.1 Aug 09 18:55:55.979914 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept: application/json Aug 09 18:55:55.979914 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept-Encoding: identity Aug 09 18:55:55.979914 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Connection: close Aug 09 18:55:55.979914 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Length: 0 Aug 09 18:55:55.979914 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Type: application/json Aug 09 18:55:55.979914 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Host: 10.222.0.57 Aug 09 18:55:55.979914 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Openstack-System-Scope: None Aug 09 18:55:55.979914 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: User-Agent: python-urllib3/1.26.11 Aug 09 18:55:55.979914 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Auth-Token: gAAAAABi8qwZ_ag6HOvV6VfPrxStvZ_C5D11u4WJJ35XK_AkKtvO85BcO7ol6twLBz-TrQeI0sjF484B2Jemv7dfj37zqEVUfS_DW_oQfHU0BVVt3muawsMgj4iXiiNusv1EFpM8BkaDG2fhDaUVNzI0WxBEqCQlTDlXGvGtMFC-Yt6_iG9BvUA Aug 09 18:55:55.979914 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Id: None Aug 09 18:55:55.979914 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Name: None Aug 09 18:55:55.979914 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Identity-Status: Confirmed Aug 09 18:55:55.979914 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Is-Admin-Project: True Aug 09 18:55:55.979914 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 18:55:55.979914 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Id: default Aug 09 18:55:55.979914 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Name: Default Aug 09 18:55:55.979914 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Id: 6d738e0a61184b4db58e2607d72cca0a Aug 09 18:55:55.979914 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1396215 Aug 09 18:55:55.979914 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Role: reader,member Aug 09 18:55:55.979914 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Roles: reader,member Aug 09 18:55:55.981716 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_6d738e0a61184b4db58e2607d72cca0a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6d738e0a61184b4db58e2607d72cca0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/6d738e0a61184b4db58e2607d72cca0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6d738e0a61184b4db58e2607d72cca0a"}]}] Aug 09 18:55:55.981716 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1396215 Aug 09 18:55:55.981716 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Id: 6d738e0a61184b4db58e2607d72cca0a Aug 09 18:55:55.981716 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1396215 Aug 09 18:55:55.981716 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User: tempest-AttachVolumeShelveTestJSON-1396215-project Aug 09 18:55:55.981716 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Id: default Aug 09 18:55:55.981716 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Name: Default Aug 09 18:55:55.981716 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Id: ef8af9fd9e844ca4be10caa880357a4f Aug 09 18:55:55.981716 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1396215-project Aug 09 18:55:55.981716 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: method: > Aug 09 18:55:55.981716 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: exception: Instance 8f84c5e3-7213-4bd2-ad7c-4794aab9d631 could not be found. Aug 09 18:55:55.981716 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: action_args: {'id': '8f84c5e3-7213-4bd2-ad7c-4794aab9d631'} Aug 09 18:55:55.982603 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:55:55.982603 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:55:55.982603 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:55:55.982603 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:55:55.982603 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:55:55.982603 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:55:55.982603 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:55:55.982603 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:55:55.982603 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:55:55.982603 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:55:55.982603 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f84c5e3-7213-4bd2-ad7c-4794aab9d631 could not be found. Aug 09 18:55:55.982603 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:55:55.982603 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:55:55.982603 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:55:55.982603 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:55:55.982603 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:55:55.982603 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:55:55.982603 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:55:55.982603 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:55:55.982603 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:55:55.983968 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:55:55.983968 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:55:55.983968 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:55:55.983968 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:55:55.983968 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:55:55.983968 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:55:55.983968 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:55:55.983968 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f84c5e3-7213-4bd2-ad7c-4794aab9d631 could not be found. Aug 09 18:55:55.983968 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:55:55.983968 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:55:55.983968 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:55:55.983968 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:55:55.983968 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:55:55.983968 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:55:55.983968 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:55:55.983968 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:55:55.983968 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f84c5e3-7213-4bd2-ad7c-4794aab9d631 could not be found. Aug 09 18:55:55.983968 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:55:55.990026 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-733a4852-3421-4a87-b9f8-f5d0bdabb831 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Returning 404 to user: Instance 8f84c5e3-7213-4bd2-ad7c-4794aab9d631 could not be found. {{(pid=124726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:55:56.000784 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-733a4852-3421-4a87-b9f8-f5d0bdabb831 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 404 len: 111 microversion: 2.20 time: 0.105750 Aug 09 18:55:56.002405 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 394/816] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:55:55 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 18:55:56.010993 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-37a63666-2d77-4483-a1fa-fc1f7fa9533e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '.version_select at 0x7f8d694610d0>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:56.107648 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-37a63666-2d77-4483-a1fa-fc1f7fa9533e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1260628463" status: 204 len: 0 microversion: 2.20 time: 0.101037 Aug 09 18:55:56.108642 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 423/817] 10.222.0.57 () {60 vars in 1262 bytes} [Tue Aug 9 18:55:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1260628463 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 18:55:58.846708 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-09d7001f-02f1-4dc1-b2a4-9f2af66d6952 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:58.847978 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-09d7001f-02f1-4dc1-b2a4-9f2af66d6952 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:58.855484 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-09d7001f-02f1-4dc1-b2a4-9f2af66d6952 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:58.856442 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-09d7001f-02f1-4dc1-b2a4-9f2af66d6952 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:58.857028 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-09d7001f-02f1-4dc1-b2a4-9f2af66d6952 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:58.858088 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-09d7001f-02f1-4dc1-b2a4-9f2af66d6952 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:58.858697 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-09d7001f-02f1-4dc1-b2a4-9f2af66d6952 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:58.859269 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-09d7001f-02f1-4dc1-b2a4-9f2af66d6952 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:58.880278 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.wsgi [None req-09d7001f-02f1-4dc1-b2a4-9f2af66d6952 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] HTTP exception thrown: Instance 8f84c5e3-7213-4bd2-ad7c-4794aab9d631 could not be found. Aug 09 18:55:58.883541 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-09d7001f-02f1-4dc1-b2a4-9f2af66d6952 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Request method failure captured: Aug 09 18:55:58.883541 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: request: DELETE /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 HTTP/1.1 Aug 09 18:55:58.883541 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept: application/json Aug 09 18:55:58.883541 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept-Encoding: identity Aug 09 18:55:58.883541 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Connection: close Aug 09 18:55:58.883541 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Length: 0 Aug 09 18:55:58.883541 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Type: application/json Aug 09 18:55:58.883541 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Host: 10.222.0.57 Aug 09 18:55:58.883541 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Openstack-System-Scope: None Aug 09 18:55:58.883541 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: User-Agent: python-urllib3/1.26.11 Aug 09 18:55:58.883541 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Auth-Token: gAAAAABi8qwZ_ag6HOvV6VfPrxStvZ_C5D11u4WJJ35XK_AkKtvO85BcO7ol6twLBz-TrQeI0sjF484B2Jemv7dfj37zqEVUfS_DW_oQfHU0BVVt3muawsMgj4iXiiNusv1EFpM8BkaDG2fhDaUVNzI0WxBEqCQlTDlXGvGtMFC-Yt6_iG9BvUA Aug 09 18:55:58.883541 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Id: None Aug 09 18:55:58.883541 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Name: None Aug 09 18:55:58.883541 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Identity-Status: Confirmed Aug 09 18:55:58.883541 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Is-Admin-Project: True Aug 09 18:55:58.883541 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 18:55:58.883541 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Id: default Aug 09 18:55:58.883541 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Name: Default Aug 09 18:55:58.883541 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Id: 6d738e0a61184b4db58e2607d72cca0a Aug 09 18:55:58.883541 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1396215 Aug 09 18:55:58.883541 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Role: reader,member Aug 09 18:55:58.883541 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Roles: reader,member Aug 09 18:55:58.885375 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_6d738e0a61184b4db58e2607d72cca0a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6d738e0a61184b4db58e2607d72cca0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/6d738e0a61184b4db58e2607d72cca0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6d738e0a61184b4db58e2607d72cca0a"}]}] Aug 09 18:55:58.885375 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1396215 Aug 09 18:55:58.885375 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Id: 6d738e0a61184b4db58e2607d72cca0a Aug 09 18:55:58.885375 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1396215 Aug 09 18:55:58.885375 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User: tempest-AttachVolumeShelveTestJSON-1396215-project Aug 09 18:55:58.885375 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Id: default Aug 09 18:55:58.885375 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Name: Default Aug 09 18:55:58.885375 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Id: ef8af9fd9e844ca4be10caa880357a4f Aug 09 18:55:58.885375 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1396215-project Aug 09 18:55:58.885375 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: method: > Aug 09 18:55:58.885375 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: exception: Instance 8f84c5e3-7213-4bd2-ad7c-4794aab9d631 could not be found. Aug 09 18:55:58.885375 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: action_args: {'id': '8f84c5e3-7213-4bd2-ad7c-4794aab9d631'} Aug 09 18:55:58.886328 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:55:58.886328 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:55:58.886328 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:55:58.886328 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:55:58.886328 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:55:58.886328 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:55:58.886328 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:55:58.886328 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:55:58.886328 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:55:58.886328 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:55:58.886328 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f84c5e3-7213-4bd2-ad7c-4794aab9d631 could not be found. Aug 09 18:55:58.886328 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:55:58.886328 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:55:58.886328 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:55:58.886328 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:55:58.886328 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:55:58.886328 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:55:58.886328 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:55:58.886328 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:55:58.886328 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:55:58.887732 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:55:58.887732 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 18:55:58.887732 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 18:55:58.887732 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 18:55:58.887732 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 18:55:58.887732 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:55:58.887732 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:55:58.887732 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:55:58.887732 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:55:58.887732 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f84c5e3-7213-4bd2-ad7c-4794aab9d631 could not be found. Aug 09 18:55:58.887732 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:55:58.887732 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:55:58.887732 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:55:58.887732 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:55:58.887732 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:55:58.887732 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:55:58.887732 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:55:58.887732 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:55:58.887732 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f84c5e3-7213-4bd2-ad7c-4794aab9d631 could not be found. Aug 09 18:55:58.887732 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:55:58.890718 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-09d7001f-02f1-4dc1-b2a4-9f2af66d6952 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Returning 404 to user: Instance 8f84c5e3-7213-4bd2-ad7c-4794aab9d631 could not be found. {{(pid=124726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:55:58.892485 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-09d7001f-02f1-4dc1-b2a4-9f2af66d6952 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 404 len: 111 microversion: 2.20 time: 0.049262 Aug 09 18:55:58.903184 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-2363a3fb-0509-4e85-be80-a181f3d1938e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:55:58.904917 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-2363a3fb-0509-4e85-be80-a181f3d1938e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 8f84c5e3-7213-4bd2-ad7c-4794aab9d631] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:55:58.908581 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 395/818] 10.222.0.57 () {60 vars in 1280 bytes} [Tue Aug 9 18:55:58 2022] DELETE /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 18:55:58.912853 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2363a3fb-0509-4e85-be80-a181f3d1938e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:58.913622 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2363a3fb-0509-4e85-be80-a181f3d1938e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:58.914226 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2363a3fb-0509-4e85-be80-a181f3d1938e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:58.915268 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2363a3fb-0509-4e85-be80-a181f3d1938e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:55:58.916081 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2363a3fb-0509-4e85-be80-a181f3d1938e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:55:58.916653 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2363a3fb-0509-4e85-be80-a181f3d1938e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:55:58.943296 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-2363a3fb-0509-4e85-be80-a181f3d1938e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] HTTP exception thrown: Instance 8f84c5e3-7213-4bd2-ad7c-4794aab9d631 could not be found. Aug 09 18:55:58.951210 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-2363a3fb-0509-4e85-be80-a181f3d1938e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Request method failure captured: Aug 09 18:55:58.951210 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: request: GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 HTTP/1.1 Aug 09 18:55:58.951210 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept: application/json Aug 09 18:55:58.951210 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Aug 09 18:55:58.951210 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Connection: close Aug 09 18:55:58.951210 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Length: 0 Aug 09 18:55:58.951210 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Type: application/json Aug 09 18:55:58.951210 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Host: 10.222.0.57 Aug 09 18:55:58.951210 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Aug 09 18:55:58.951210 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.11 Aug 09 18:55:58.951210 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABi8qwZ_ag6HOvV6VfPrxStvZ_C5D11u4WJJ35XK_AkKtvO85BcO7ol6twLBz-TrQeI0sjF484B2Jemv7dfj37zqEVUfS_DW_oQfHU0BVVt3muawsMgj4iXiiNusv1EFpM8BkaDG2fhDaUVNzI0WxBEqCQlTDlXGvGtMFC-Yt6_iG9BvUA Aug 09 18:55:58.951210 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Aug 09 18:55:58.951210 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Aug 09 18:55:58.951210 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Aug 09 18:55:58.951210 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Aug 09 18:55:58.951210 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 18:55:58.951210 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Aug 09 18:55:58.951210 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Aug 09 18:55:58.951210 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Id: 6d738e0a61184b4db58e2607d72cca0a Aug 09 18:55:58.951210 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1396215 Aug 09 18:55:58.951210 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Role: reader,member Aug 09 18:55:58.951210 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Roles: reader,member Aug 09 18:55:58.952631 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_6d738e0a61184b4db58e2607d72cca0a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6d738e0a61184b4db58e2607d72cca0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/6d738e0a61184b4db58e2607d72cca0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6d738e0a61184b4db58e2607d72cca0a"}]}] Aug 09 18:55:58.952631 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1396215 Aug 09 18:55:58.952631 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 6d738e0a61184b4db58e2607d72cca0a Aug 09 18:55:58.952631 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1396215 Aug 09 18:55:58.952631 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User: tempest-AttachVolumeShelveTestJSON-1396215-project Aug 09 18:55:58.952631 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Aug 09 18:55:58.952631 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Aug 09 18:55:58.952631 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Id: ef8af9fd9e844ca4be10caa880357a4f Aug 09 18:55:58.952631 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1396215-project Aug 09 18:55:58.952631 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: method: > Aug 09 18:55:58.952631 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: exception: Instance 8f84c5e3-7213-4bd2-ad7c-4794aab9d631 could not be found. Aug 09 18:55:58.952631 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: action_args: {'id': '8f84c5e3-7213-4bd2-ad7c-4794aab9d631'} Aug 09 18:55:58.953374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:55:58.953374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:55:58.953374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:55:58.953374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:55:58.953374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:55:58.953374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:55:58.953374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:55:58.953374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:55:58.953374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:55:58.953374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:55:58.953374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f84c5e3-7213-4bd2-ad7c-4794aab9d631 could not be found. Aug 09 18:55:58.953374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:55:58.953374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:55:58.953374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:55:58.953374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:55:58.953374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:55:58.953374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:55:58.953374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:55:58.953374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:55:58.953374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:55:58.956401 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:55:58.956401 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:55:58.956401 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:55:58.956401 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:55:58.956401 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:55:58.956401 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:55:58.956401 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:55:58.956401 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f84c5e3-7213-4bd2-ad7c-4794aab9d631 could not be found. Aug 09 18:55:58.956401 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:55:58.956401 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:55:58.956401 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:55:58.956401 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:55:58.956401 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:55:58.956401 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:55:58.956401 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:55:58.956401 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:55:58.956401 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f84c5e3-7213-4bd2-ad7c-4794aab9d631 could not be found. Aug 09 18:55:58.956401 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:55:58.958094 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-2363a3fb-0509-4e85-be80-a181f3d1938e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Returning 404 to user: Instance 8f84c5e3-7213-4bd2-ad7c-4794aab9d631 could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:55:58.958094 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-2363a3fb-0509-4e85-be80-a181f3d1938e tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631" status: 404 len: 111 microversion: 2.20 time: 0.049617 Aug 09 18:55:58.958094 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 424/819] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:55:58 2022] GET /compute/v2.1/servers/8f84c5e3-7213-4bd2-ad7c-4794aab9d631 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 18:56:00.459697 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-112f6440-8e8f-4388-a7e4-eb8a53968358 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:00.460192 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-112f6440-8e8f-4388-a7e4-eb8a53968358 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:00.475155 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-112f6440-8e8f-4388-a7e4-eb8a53968358 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:00.475730 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-112f6440-8e8f-4388-a7e4-eb8a53968358 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:00.476570 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-112f6440-8e8f-4388-a7e4-eb8a53968358 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:00.477703 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-112f6440-8e8f-4388-a7e4-eb8a53968358 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:00.478680 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-112f6440-8e8f-4388-a7e4-eb8a53968358 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:00.480086 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-112f6440-8e8f-4388-a7e4-eb8a53968358 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:00.506048 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.wsgi [None req-112f6440-8e8f-4388-a7e4-eb8a53968358 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] HTTP exception thrown: Instance 22aac118-db08-4aca-a5e7-3f2cad5e49fd could not be found. Aug 09 18:56:00.509597 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-112f6440-8e8f-4388-a7e4-eb8a53968358 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Request method failure captured: Aug 09 18:56:00.509597 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: request: DELETE /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd HTTP/1.1 Aug 09 18:56:00.509597 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept: application/json Aug 09 18:56:00.509597 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept-Encoding: identity Aug 09 18:56:00.509597 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Connection: close Aug 09 18:56:00.509597 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Length: 0 Aug 09 18:56:00.509597 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Type: application/json Aug 09 18:56:00.509597 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Host: 10.222.0.57 Aug 09 18:56:00.509597 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Openstack-System-Scope: None Aug 09 18:56:00.509597 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: User-Agent: python-urllib3/1.26.11 Aug 09 18:56:00.509597 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Auth-Token: gAAAAABi8qwZ_ag6HOvV6VfPrxStvZ_C5D11u4WJJ35XK_AkKtvO85BcO7ol6twLBz-TrQeI0sjF484B2Jemv7dfj37zqEVUfS_DW_oQfHU0BVVt3muawsMgj4iXiiNusv1EFpM8BkaDG2fhDaUVNzI0WxBEqCQlTDlXGvGtMFC-Yt6_iG9BvUA Aug 09 18:56:00.509597 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Id: None Aug 09 18:56:00.509597 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Name: None Aug 09 18:56:00.509597 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Identity-Status: Confirmed Aug 09 18:56:00.509597 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Is-Admin-Project: True Aug 09 18:56:00.509597 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 18:56:00.509597 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Id: default Aug 09 18:56:00.509597 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Name: Default Aug 09 18:56:00.509597 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Id: 6d738e0a61184b4db58e2607d72cca0a Aug 09 18:56:00.509597 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1396215 Aug 09 18:56:00.509597 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Role: reader,member Aug 09 18:56:00.509597 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Roles: reader,member Aug 09 18:56:00.511945 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_6d738e0a61184b4db58e2607d72cca0a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6d738e0a61184b4db58e2607d72cca0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/6d738e0a61184b4db58e2607d72cca0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6d738e0a61184b4db58e2607d72cca0a"}]}] Aug 09 18:56:00.511945 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1396215 Aug 09 18:56:00.511945 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Id: 6d738e0a61184b4db58e2607d72cca0a Aug 09 18:56:00.511945 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1396215 Aug 09 18:56:00.511945 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User: tempest-AttachVolumeShelveTestJSON-1396215-project Aug 09 18:56:00.511945 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Id: default Aug 09 18:56:00.511945 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Name: Default Aug 09 18:56:00.511945 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Id: ef8af9fd9e844ca4be10caa880357a4f Aug 09 18:56:00.511945 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1396215-project Aug 09 18:56:00.511945 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: method: > Aug 09 18:56:00.511945 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: exception: Instance 22aac118-db08-4aca-a5e7-3f2cad5e49fd could not be found. Aug 09 18:56:00.511945 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: action_args: {'id': '22aac118-db08-4aca-a5e7-3f2cad5e49fd'} Aug 09 18:56:00.512867 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:56:00.512867 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:00.512867 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:56:00.512867 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:56:00.512867 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:56:00.512867 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:56:00.512867 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:56:00.512867 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:56:00.512867 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:56:00.512867 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:56:00.512867 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22aac118-db08-4aca-a5e7-3f2cad5e49fd could not be found. Aug 09 18:56:00.512867 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:00.512867 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:00.512867 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:00.512867 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:00.512867 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:56:00.512867 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:56:00.512867 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:56:00.512867 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:56:00.512867 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:56:00.514388 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:56:00.514388 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 18:56:00.514388 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 18:56:00.514388 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 18:56:00.514388 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 18:56:00.514388 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:56:00.514388 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:56:00.514388 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:56:00.514388 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:56:00.514388 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22aac118-db08-4aca-a5e7-3f2cad5e49fd could not be found. Aug 09 18:56:00.514388 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:00.514388 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:00.514388 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:00.514388 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:00.514388 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:56:00.514388 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:56:00.514388 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:56:00.514388 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:56:00.514388 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22aac118-db08-4aca-a5e7-3f2cad5e49fd could not be found. Aug 09 18:56:00.514388 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:00.519286 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-112f6440-8e8f-4388-a7e4-eb8a53968358 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Returning 404 to user: Instance 22aac118-db08-4aca-a5e7-3f2cad5e49fd could not be found. {{(pid=124726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:56:00.519286 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-112f6440-8e8f-4388-a7e4-eb8a53968358 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "DELETE /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 404 len: 111 microversion: 2.20 time: 0.057133 Aug 09 18:56:00.520368 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 396/820] 10.222.0.57 () {60 vars in 1280 bytes} [Tue Aug 9 18:56:00 2022] DELETE /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 18:56:00.528675 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-84e4d3fd-3990-4911-b1a5-7bb8b04dbb15 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:00.529284 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-84e4d3fd-3990-4911-b1a5-7bb8b04dbb15 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] [instance: 22aac118-db08-4aca-a5e7-3f2cad5e49fd] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:00.546580 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-84e4d3fd-3990-4911-b1a5-7bb8b04dbb15 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:00.548546 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-84e4d3fd-3990-4911-b1a5-7bb8b04dbb15 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:00.549985 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-84e4d3fd-3990-4911-b1a5-7bb8b04dbb15 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:00.551848 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-84e4d3fd-3990-4911-b1a5-7bb8b04dbb15 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:00.554775 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-84e4d3fd-3990-4911-b1a5-7bb8b04dbb15 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:00.558506 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-84e4d3fd-3990-4911-b1a5-7bb8b04dbb15 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:00.597653 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-84e4d3fd-3990-4911-b1a5-7bb8b04dbb15 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] HTTP exception thrown: Instance 22aac118-db08-4aca-a5e7-3f2cad5e49fd could not be found. Aug 09 18:56:00.604130 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-84e4d3fd-3990-4911-b1a5-7bb8b04dbb15 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Request method failure captured: Aug 09 18:56:00.604130 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: request: GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd HTTP/1.1 Aug 09 18:56:00.604130 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept: application/json Aug 09 18:56:00.604130 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Aug 09 18:56:00.604130 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Connection: close Aug 09 18:56:00.604130 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Length: 0 Aug 09 18:56:00.604130 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Type: application/json Aug 09 18:56:00.604130 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Host: 10.222.0.57 Aug 09 18:56:00.604130 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Aug 09 18:56:00.604130 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.11 Aug 09 18:56:00.604130 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABi8qwZ_ag6HOvV6VfPrxStvZ_C5D11u4WJJ35XK_AkKtvO85BcO7ol6twLBz-TrQeI0sjF484B2Jemv7dfj37zqEVUfS_DW_oQfHU0BVVt3muawsMgj4iXiiNusv1EFpM8BkaDG2fhDaUVNzI0WxBEqCQlTDlXGvGtMFC-Yt6_iG9BvUA Aug 09 18:56:00.604130 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Aug 09 18:56:00.604130 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Aug 09 18:56:00.604130 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Aug 09 18:56:00.604130 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Aug 09 18:56:00.604130 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 18:56:00.604130 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Aug 09 18:56:00.604130 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Aug 09 18:56:00.604130 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Id: 6d738e0a61184b4db58e2607d72cca0a Aug 09 18:56:00.604130 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1396215 Aug 09 18:56:00.604130 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Role: reader,member Aug 09 18:56:00.604130 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Roles: reader,member Aug 09 18:56:00.605593 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_6d738e0a61184b4db58e2607d72cca0a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6d738e0a61184b4db58e2607d72cca0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/6d738e0a61184b4db58e2607d72cca0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6d738e0a61184b4db58e2607d72cca0a"}]}] Aug 09 18:56:00.605593 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1396215 Aug 09 18:56:00.605593 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 6d738e0a61184b4db58e2607d72cca0a Aug 09 18:56:00.605593 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1396215 Aug 09 18:56:00.605593 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User: tempest-AttachVolumeShelveTestJSON-1396215-project Aug 09 18:56:00.605593 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Aug 09 18:56:00.605593 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Aug 09 18:56:00.605593 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Id: ef8af9fd9e844ca4be10caa880357a4f Aug 09 18:56:00.605593 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1396215-project Aug 09 18:56:00.605593 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: method: > Aug 09 18:56:00.605593 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: exception: Instance 22aac118-db08-4aca-a5e7-3f2cad5e49fd could not be found. Aug 09 18:56:00.605593 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: action_args: {'id': '22aac118-db08-4aca-a5e7-3f2cad5e49fd'} Aug 09 18:56:00.610427 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:56:00.610427 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:00.610427 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:56:00.610427 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:56:00.610427 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:56:00.610427 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:56:00.610427 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:56:00.610427 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:56:00.610427 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:56:00.610427 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:56:00.610427 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22aac118-db08-4aca-a5e7-3f2cad5e49fd could not be found. Aug 09 18:56:00.610427 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:00.610427 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:00.610427 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:00.610427 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:00.610427 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:56:00.610427 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:56:00.610427 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:56:00.610427 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:56:00.610427 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:56:00.612518 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:56:00.612518 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:56:00.612518 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:56:00.612518 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:56:00.612518 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:56:00.612518 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:56:00.612518 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:56:00.612518 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22aac118-db08-4aca-a5e7-3f2cad5e49fd could not be found. Aug 09 18:56:00.612518 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:00.612518 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:00.612518 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:00.612518 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:00.612518 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:56:00.612518 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:56:00.612518 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:56:00.612518 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:56:00.612518 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22aac118-db08-4aca-a5e7-3f2cad5e49fd could not be found. Aug 09 18:56:00.612518 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:00.613971 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-84e4d3fd-3990-4911-b1a5-7bb8b04dbb15 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] Returning 404 to user: Instance 22aac118-db08-4aca-a5e7-3f2cad5e49fd could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:56:00.613971 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-84e4d3fd-3990-4911-b1a5-7bb8b04dbb15 tempest-AttachVolumeShelveTestJSON-1396215 tempest-AttachVolumeShelveTestJSON-1396215-project] 10.222.0.57 "GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd" status: 404 len: 111 microversion: 2.20 time: 0.082185 Aug 09 18:56:00.613971 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 425/821] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 9 18:56:00 2022] GET /compute/v2.1/servers/22aac118-db08-4aca-a5e7-3f2cad5e49fd => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 18:56:01.239889 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-73abc8e0-ff40-4b89-9bf6-5f19b2fd4485 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:01.240664 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-73abc8e0-ff40-4b89-9bf6-5f19b2fd4485 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: f349cf3d-5117-4617-ad83-8c0cc44f5bd5] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:01.249355 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-73abc8e0-ff40-4b89-9bf6-5f19b2fd4485 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:01.250094 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-73abc8e0-ff40-4b89-9bf6-5f19b2fd4485 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:01.250691 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-73abc8e0-ff40-4b89-9bf6-5f19b2fd4485 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:01.252145 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-73abc8e0-ff40-4b89-9bf6-5f19b2fd4485 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:01.252769 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-73abc8e0-ff40-4b89-9bf6-5f19b2fd4485 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:01.253365 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-73abc8e0-ff40-4b89-9bf6-5f19b2fd4485 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:01.287317 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-73abc8e0-ff40-4b89-9bf6-5f19b2fd4485 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5/ips" status: 200 len: 150 microversion: 2.1 time: 0.485951 Aug 09 18:56:01.288169 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 397/822] 10.222.0.57 () {58 vars in 1248 bytes} [Tue Aug 9 18:56:00 2022] GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5/ips => generated 150 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:56:03.393975 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-4251c361-9996-4783-b6ee-7946d52856d4 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c10fd50d-b4cb-45dd-a97f-48661e083534"}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:56:03.396400 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-4251c361-9996-4783-b6ee-7946d52856d4 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: f349cf3d-5117-4617-ad83-8c0cc44f5bd5] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:03.403527 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4251c361-9996-4783-b6ee-7946d52856d4 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:03.404224 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4251c361-9996-4783-b6ee-7946d52856d4 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:03.404803 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4251c361-9996-4783-b6ee-7946d52856d4 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:03.405698 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4251c361-9996-4783-b6ee-7946d52856d4 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:03.406302 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4251c361-9996-4783-b6ee-7946d52856d4 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:03.406940 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4251c361-9996-4783-b6ee-7946d52856d4 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:04.669127 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-4251c361-9996-4783-b6ee-7946d52856d4 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "POST /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.278991 Aug 09 18:56:04.670206 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 426/823] 10.222.0.57 () {60 vars in 1323 bytes} [Tue Aug 9 18:56:03 2022] POST /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5/os-volume_attachments => generated 194 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:56:09.653293 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-808e6260-90e5-497b-97ab-26df6ba1a556 tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] Action: 'create', calling method: .version_select at 0x7f8d69c02ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1558616374"}} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:56:10.402362 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-808e6260-90e5-497b-97ab-26df6ba1a556 tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.880370 Aug 09 18:56:10.405664 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 398/824] 10.222.0.57 () {60 vars in 1155 bytes} [Tue Aug 9 18:56:09 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 882 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 09 18:56:10.415929 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-222ae569-1999-4ee8-9fcd-42ba81054408 tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] Calling method '.version_select at 0x7f8d694320d0>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:10.473028 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-222ae569-1999-4ee8-9fcd-42ba81054408 tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/5be2d5b3-feef-48eb-8922-86721d586127" status: 200 len: 345 microversion: 2.1 time: 0.060621 Aug 09 18:56:10.479914 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 427/825] 10.222.0.57 () {58 vars in 1245 bytes} [Tue Aug 9 18:56:10 2022] GET /compute/v2.1/os-volumes/5be2d5b3-feef-48eb-8922-86721d586127 => generated 345 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:56:11.434323 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:56:11.435385 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:56:11.439902 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-9fa648b1-1fad-47bf-a58a-30cc8a42e51f tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-397914147", "imageRef": "124dd477-ccfa-4be3-9973-6b1f33b47df8", "flavorRef": "452", "networks": [{"uuid": "fb9b1070-1154-42f7-9f77-53f9652718c0"}]}} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:56:11.557586 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-08533415-7a39-43cf-b9fe-db2e99de924e tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] Calling method '.version_select at 0x7f8d69461e50>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:11.559408 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.network.neutron [None req-9fa648b1-1fad-47bf-a58a-30cc8a42e51f tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] validate_networks() for [('fb9b1070-1154-42f7-9f77-53f9652718c0', None, None, None, None, None)] {{(pid=124726) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:56:11.559506 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-08533415-7a39-43cf-b9fe-db2e99de924e tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/5be2d5b3-feef-48eb-8922-86721d586127" status: 200 len: 346 microversion: 2.1 time: 0.057241 Aug 09 18:56:11.559506 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 428/826] 10.222.0.57 () {58 vars in 1245 bytes} [Tue Aug 9 18:56:11 2022] GET /compute/v2.1/os-volumes/5be2d5b3-feef-48eb-8922-86721d586127 => generated 346 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:56:11.570000 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-712eeb05-0f65-46d7-a3d2-23c1fdad7e0a tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] Action: 'create', calling method: .version_select at 0x7f8d69430a60>, body: {"snapshot": {"volume_id": "5be2d5b3-feef-48eb-8922-86721d586127", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-914810025"}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:56:11.884103 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.virt.hardware [None req-9fa648b1-1fad-47bf-a58a-30cc8a42e51f tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Flavor limits 0:0:0 {{(pid=124726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:56:11.884817 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.virt.hardware [None req-9fa648b1-1fad-47bf-a58a-30cc8a42e51f tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Image limits 0:0:0 {{(pid=124726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:56:11.885865 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.virt.hardware [None req-9fa648b1-1fad-47bf-a58a-30cc8a42e51f tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Flavor pref 0:0:0 {{(pid=124726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:56:11.886594 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.virt.hardware [None req-9fa648b1-1fad-47bf-a58a-30cc8a42e51f tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Image pref 0:0:0 {{(pid=124726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:56:11.887680 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.virt.hardware [None req-9fa648b1-1fad-47bf-a58a-30cc8a42e51f tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:56:11.897605 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9fa648b1-1fad-47bf-a58a-30cc8a42e51f tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:11.898358 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9fa648b1-1fad-47bf-a58a-30cc8a42e51f tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:11.898946 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9fa648b1-1fad-47bf-a58a-30cc8a42e51f tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:11.899959 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9fa648b1-1fad-47bf-a58a-30cc8a42e51f tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:11.900682 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9fa648b1-1fad-47bf-a58a-30cc8a42e51f tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:11.901289 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9fa648b1-1fad-47bf-a58a-30cc8a42e51f tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:11.919509 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.quota [None req-9fa648b1-1fad-47bf-a58a-30cc8a42e51f tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Getting quotas for project 7e81a89ed40c43f28ac96cbe3744e6c0. Resources: {'cores', 'ram', 'instances'} {{(pid=124726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:56:11.924703 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.quota [None req-9fa648b1-1fad-47bf-a58a-30cc8a42e51f tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Getting quotas for user aa415c4e0e9c4928b51152fa0a428d9b and project 7e81a89ed40c43f28ac96cbe3744e6c0. Resources: {'cores', 'ram', 'instances'} {{(pid=124726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:56:11.939351 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-9fa648b1-1fad-47bf-a58a-30cc8a42e51f tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Going to run 1 instances... {{(pid=124726) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:56:11.945433 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-9fa648b1-1fad-47bf-a58a-30cc8a42e51f tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='124dd477-ccfa-4be3-9973-6b1f33b47df8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:56:12.096891 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-9fa648b1-1fad-47bf-a58a-30cc8a42e51f tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.663694 Aug 09 18:56:12.097792 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 399/827] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 9 18:56:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:56:12.109429 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-d473f17c-e318-4d61-83bb-32c10663ce79 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:12.110343 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-d473f17c-e318-4d61-83bb-32c10663ce79 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:12.165702 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-d473f17c-e318-4d61-83bb-32c10663ce79 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:12.173353 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-d473f17c-e318-4d61-83bb-32c10663ce79 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37" status: 200 len: 1218 microversion: 2.1 time: 0.068444 Aug 09 18:56:12.173963 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 400/828] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:12 2022] GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37 => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:56:12.221965 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-712eeb05-0f65-46d7-a3d2-23c1fdad7e0a tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] 10.222.0.57 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.654944 Aug 09 18:56:12.221965 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 429/829] 10.222.0.57 () {60 vars in 1162 bytes} [Tue Aug 9 18:56:11 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:56:12.233017 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-c69d315b-cb60-4f7f-b2b6-2d3d55055649 tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] Calling method '.version_select at 0x7f8d69b97e50>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:12.269676 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-c69d315b-cb60-4f7f-b2b6-2d3d55055649 tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/6b84c337-d462-4d14-9500-9efe40f3e22e" status: 200 len: 286 microversion: 2.1 time: 0.040548 Aug 09 18:56:12.270665 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 401/830] 10.222.0.57 () {58 vars in 1251 bytes} [Tue Aug 9 18:56:12 2022] GET /compute/v2.1/os-snapshots/6b84c337-d462-4d14-9500-9efe40f3e22e => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:56:12.281833 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d04e9904-5114-4805-87c4-c1c210c68aae tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] Calling method '.version_select at 0x7f8d694309d0>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:12.319176 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-d04e9904-5114-4805-87c4-c1c210c68aae tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.041851 Aug 09 18:56:12.319736 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 430/831] 10.222.0.57 () {58 vars in 1140 bytes} [Tue Aug 9 18:56:12 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:56:12.334294 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-510d3907-1bdc-420f-a580-d8998cf977fe tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] Calling method '.version_select at 0x7f8d69bf0b80>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:12.366608 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-510d3907-1bdc-420f-a580-d8998cf977fe tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/6b84c337-d462-4d14-9500-9efe40f3e22e" status: 200 len: 286 microversion: 2.1 time: 0.038329 Aug 09 18:56:12.366608 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 402/832] 10.222.0.57 () {58 vars in 1251 bytes} [Tue Aug 9 18:56:12 2022] GET /compute/v2.1/os-snapshots/6b84c337-d462-4d14-9500-9efe40f3e22e => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:56:12.512663 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-3985b6b4-cc36-47c7-b7a6-00818cd4ec41 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Action: 'create', calling method: .version_select at 0x7f8d69452a60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1423496390", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwJdo4uJSRYTExI5HSAZbSayw0zv2bcZWZfXKo+4+vTXLvpXHEsLA9VqZEceHCJ8y7/HoTbGZlSSToQDIaTHdPdbpAxpBPVtO4Hm+35Dr2qzSFG4hBq0V20wEEpvw5iow=="}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:56:12.530552 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-3985b6b4-cc36-47c7-b7a6-00818cd4ec41 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Getting quotas for project 6bedacf1dd4e4398ae3acefcd58a93a8. Resources: {'key_pairs'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:56:12.533498 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-3985b6b4-cc36-47c7-b7a6-00818cd4ec41 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Getting quotas for user db26f48da0af4723afb2c0a4c5f52d07 and project 6bedacf1dd4e4398ae3acefcd58a93a8. Resources: {'key_pairs'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:56:12.583851 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-79b12301-9c7f-439a-9d28-f2cabd3237fd tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:12.584352 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-79b12301-9c7f-439a-9d28-f2cabd3237fd tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: f349cf3d-5117-4617-ad83-8c0cc44f5bd5] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:12.591288 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-79b12301-9c7f-439a-9d28-f2cabd3237fd tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:12.591782 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-79b12301-9c7f-439a-9d28-f2cabd3237fd tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:12.592206 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-79b12301-9c7f-439a-9d28-f2cabd3237fd tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:12.592896 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-79b12301-9c7f-439a-9d28-f2cabd3237fd tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:12.593350 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-79b12301-9c7f-439a-9d28-f2cabd3237fd tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:12.594055 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-79b12301-9c7f-439a-9d28-f2cabd3237fd tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:12.603549 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-3985b6b4-cc36-47c7-b7a6-00818cd4ec41 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.095214 Aug 09 18:56:12.604395 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 431/833] 10.222.0.57 () {60 vars in 1159 bytes} [Tue Aug 9 18:56:12 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:56:12.677391 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.objects.instance [None req-79b12301-9c7f-439a-9d28-f2cabd3237fd tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lazy-loading 'services' on Instance uuid f349cf3d-5117-4617-ad83-8c0cc44f5bd5 {{(pid=124726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:56:12.721144 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b8da9003-f5d1-44b4-b7f6-e299b3bd5c6c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1052491842", "imageRef": "22a5b136-de92-4f04-bf0b-a44c74c13282", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1423496390", "networks": [{"uuid": "02777cac-8107-4909-8fe1-1c75d358a36d"}]}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:56:12.778312 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.network.neutron [None req-b8da9003-f5d1-44b4-b7f6-e299b3bd5c6c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] validate_networks() for [('02777cac-8107-4909-8fe1-1c75d358a36d', None, None, None, None, None)] {{(pid=124725) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:56:12.888781 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-79b12301-9c7f-439a-9d28-f2cabd3237fd tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5/os-volume_attachments/c10fd50d-b4cb-45dd-a97f-48661e083534" status: 202 len: 0 microversion: 2.1 time: 0.308977 Aug 09 18:56:12.889843 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 403/834] 10.222.0.57 () {58 vars in 1416 bytes} [Tue Aug 9 18:56:12 2022] DELETE /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5/os-volume_attachments/c10fd50d-b4cb-45dd-a97f-48661e083534 => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:56:12.910811 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-2ab7a485-3b85-4576-90e2-5e79c0b6aeda tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:12.913228 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-2ab7a485-3b85-4576-90e2-5e79c0b6aeda tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: f349cf3d-5117-4617-ad83-8c0cc44f5bd5] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:12.920259 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2ab7a485-3b85-4576-90e2-5e79c0b6aeda tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:12.920659 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2ab7a485-3b85-4576-90e2-5e79c0b6aeda tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:12.921098 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2ab7a485-3b85-4576-90e2-5e79c0b6aeda tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:12.922069 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2ab7a485-3b85-4576-90e2-5e79c0b6aeda tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:12.922317 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2ab7a485-3b85-4576-90e2-5e79c0b6aeda tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:12.922981 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2ab7a485-3b85-4576-90e2-5e79c0b6aeda tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:12.955513 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-2ab7a485-3b85-4576-90e2-5e79c0b6aeda tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061022 Aug 09 18:56:12.956082 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 404/835] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 9 18:56:12 2022] GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:56:12.967950 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:56:13.160435 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-b8da9003-f5d1-44b4-b7f6-e299b3bd5c6c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Flavor limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:56:13.160855 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-b8da9003-f5d1-44b4-b7f6-e299b3bd5c6c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Image limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:56:13.161476 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-b8da9003-f5d1-44b4-b7f6-e299b3bd5c6c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Flavor pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:56:13.161917 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-b8da9003-f5d1-44b4-b7f6-e299b3bd5c6c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Image pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:56:13.162317 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-b8da9003-f5d1-44b4-b7f6-e299b3bd5c6c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:56:13.171120 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b8da9003-f5d1-44b4-b7f6-e299b3bd5c6c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:13.171601 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b8da9003-f5d1-44b4-b7f6-e299b3bd5c6c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:13.172054 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b8da9003-f5d1-44b4-b7f6-e299b3bd5c6c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:13.172752 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b8da9003-f5d1-44b4-b7f6-e299b3bd5c6c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:13.173251 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b8da9003-f5d1-44b4-b7f6-e299b3bd5c6c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:13.173824 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b8da9003-f5d1-44b4-b7f6-e299b3bd5c6c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:13.181508 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:56:13.194062 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-eb7abd28-1735-48be-99f2-e5483c326303 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:13.194353 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-b8da9003-f5d1-44b4-b7f6-e299b3bd5c6c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Getting quotas for project 6bedacf1dd4e4398ae3acefcd58a93a8. Resources: {'cores', 'ram', 'instances'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:56:13.194694 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-eb7abd28-1735-48be-99f2-e5483c326303 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:13.198500 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-b8da9003-f5d1-44b4-b7f6-e299b3bd5c6c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Getting quotas for user db26f48da0af4723afb2c0a4c5f52d07 and project 6bedacf1dd4e4398ae3acefcd58a93a8. Resources: {'cores', 'ram', 'instances'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:56:13.200670 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-eb7abd28-1735-48be-99f2-e5483c326303 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:13.201346 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-eb7abd28-1735-48be-99f2-e5483c326303 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:13.201836 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-eb7abd28-1735-48be-99f2-e5483c326303 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:13.202527 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-eb7abd28-1735-48be-99f2-e5483c326303 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:13.202977 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-eb7abd28-1735-48be-99f2-e5483c326303 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:13.203440 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-eb7abd28-1735-48be-99f2-e5483c326303 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:13.211852 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-b8da9003-f5d1-44b4-b7f6-e299b3bd5c6c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Going to run 1 instances... {{(pid=124725) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:56:13.214276 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-b8da9003-f5d1-44b4-b7f6-e299b3bd5c6c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22a5b136-de92-4f04-bf0b-a44c74c13282',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:56:13.268070 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-eb7abd28-1735-48be-99f2-e5483c326303 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:13.277711 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-eb7abd28-1735-48be-99f2-e5483c326303 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37" status: 200 len: 1222 microversion: 2.1 time: 0.087329 Aug 09 18:56:13.278674 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 405/836] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:13 2022] GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37 => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:56:13.318517 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-b8da9003-f5d1-44b4-b7f6-e299b3bd5c6c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.605629 Aug 09 18:56:13.319163 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 432/837] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 9 18:56:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:56:13.330329 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-de79b5a5-249a-4206-8215-6ad38d099f01 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:13.330932 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-de79b5a5-249a-4206-8215-6ad38d099f01 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:13.379599 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-aebd66d2-3f92-4d17-aa7b-d99caa4b4129 tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] Calling method '.version_select at 0x7f8d69483dc0>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:13.386606 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-de79b5a5-249a-4206-8215-6ad38d099f01 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:13.396002 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-de79b5a5-249a-4206-8215-6ad38d099f01 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1259 microversion: 2.1 time: 0.069675 Aug 09 18:56:13.396909 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 406/838] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:13 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1259 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:56:13.413156 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-aebd66d2-3f92-4d17-aa7b-d99caa4b4129 tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/6b84c337-d462-4d14-9500-9efe40f3e22e" status: 200 len: 286 microversion: 2.1 time: 0.038718 Aug 09 18:56:13.413776 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 433/839] 10.222.0.57 () {58 vars in 1251 bytes} [Tue Aug 9 18:56:13 2022] GET /compute/v2.1/os-snapshots/6b84c337-d462-4d14-9500-9efe40f3e22e => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:56:13.967984 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-e0ceb04b-895e-48b7-bc65-dc9513fff23a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:13.970648 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-e0ceb04b-895e-48b7-bc65-dc9513fff23a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: f349cf3d-5117-4617-ad83-8c0cc44f5bd5] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:13.978656 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e0ceb04b-895e-48b7-bc65-dc9513fff23a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:13.979142 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e0ceb04b-895e-48b7-bc65-dc9513fff23a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:13.979575 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e0ceb04b-895e-48b7-bc65-dc9513fff23a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:13.980265 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e0ceb04b-895e-48b7-bc65-dc9513fff23a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:13.980718 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e0ceb04b-895e-48b7-bc65-dc9513fff23a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:13.981143 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e0ceb04b-895e-48b7-bc65-dc9513fff23a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:14.159495 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-e0ceb04b-895e-48b7-bc65-dc9513fff23a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.195411 Aug 09 18:56:14.160039 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 407/840] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 9 18:56:13 2022] GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5/os-volume_attachments => generated 197 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:56:14.299086 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-44fdaea4-5af5-47b7-8860-f2e565eec283 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:14.299720 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-44fdaea4-5af5-47b7-8860-f2e565eec283 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:14.306544 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-44fdaea4-5af5-47b7-8860-f2e565eec283 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:14.307023 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-44fdaea4-5af5-47b7-8860-f2e565eec283 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:14.307452 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-44fdaea4-5af5-47b7-8860-f2e565eec283 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:14.308135 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-44fdaea4-5af5-47b7-8860-f2e565eec283 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:14.308583 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-44fdaea4-5af5-47b7-8860-f2e565eec283 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:14.309001 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-44fdaea4-5af5-47b7-8860-f2e565eec283 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:14.370435 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-44fdaea4-5af5-47b7-8860-f2e565eec283 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:14.378257 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-44fdaea4-5af5-47b7-8860-f2e565eec283 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37" status: 200 len: 1222 microversion: 2.1 time: 0.083904 Aug 09 18:56:14.378810 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 434/841] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:14 2022] GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:56:14.416096 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-f40d76e6-dfcd-4037-b3e4-19837b143f42 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:14.416805 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-f40d76e6-dfcd-4037-b3e4-19837b143f42 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:14.423473 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f40d76e6-dfcd-4037-b3e4-19837b143f42 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:14.423473 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f40d76e6-dfcd-4037-b3e4-19837b143f42 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:14.423924 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f40d76e6-dfcd-4037-b3e4-19837b143f42 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:14.424615 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f40d76e6-dfcd-4037-b3e4-19837b143f42 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:14.425068 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f40d76e6-dfcd-4037-b3e4-19837b143f42 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:14.425490 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f40d76e6-dfcd-4037-b3e4-19837b143f42 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:14.426072 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-104435ae-6876-4ee8-a29a-200e90e0c512 tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] Calling method '.version_select at 0x7f8d6947ddc0>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:14.457218 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-104435ae-6876-4ee8-a29a-200e90e0c512 tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/6b84c337-d462-4d14-9500-9efe40f3e22e" status: 200 len: 286 microversion: 2.1 time: 0.035316 Aug 09 18:56:14.457836 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 435/842] 10.222.0.57 () {58 vars in 1251 bytes} [Tue Aug 9 18:56:14 2022] GET /compute/v2.1/os-snapshots/6b84c337-d462-4d14-9500-9efe40f3e22e => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:56:14.492518 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-f40d76e6-dfcd-4037-b3e4-19837b143f42 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:14.500106 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-f40d76e6-dfcd-4037-b3e4-19837b143f42 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1263 microversion: 2.1 time: 0.087834 Aug 09 18:56:14.500742 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 408/843] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:14 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1263 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:56:15.171388 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-813d1a59-d855-4a9a-8ee4-43db7b56352a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:15.174256 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-813d1a59-d855-4a9a-8ee4-43db7b56352a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: f349cf3d-5117-4617-ad83-8c0cc44f5bd5] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:15.180186 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-813d1a59-d855-4a9a-8ee4-43db7b56352a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:15.180670 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-813d1a59-d855-4a9a-8ee4-43db7b56352a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:15.181104 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-813d1a59-d855-4a9a-8ee4-43db7b56352a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:15.181837 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-813d1a59-d855-4a9a-8ee4-43db7b56352a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:15.182380 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-813d1a59-d855-4a9a-8ee4-43db7b56352a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:15.182783 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-813d1a59-d855-4a9a-8ee4-43db7b56352a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:15.212692 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-813d1a59-d855-4a9a-8ee4-43db7b56352a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045525 Aug 09 18:56:15.213264 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 436/844] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 9 18:56:15 2022] GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:56:15.398919 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-a9b22827-f6e8-4d22-abfc-ae536c7bd97c tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:15.399576 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-a9b22827-f6e8-4d22-abfc-ae536c7bd97c tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:15.406187 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a9b22827-f6e8-4d22-abfc-ae536c7bd97c tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:15.406606 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a9b22827-f6e8-4d22-abfc-ae536c7bd97c tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:15.407034 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a9b22827-f6e8-4d22-abfc-ae536c7bd97c tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:15.407717 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a9b22827-f6e8-4d22-abfc-ae536c7bd97c tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:15.408197 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a9b22827-f6e8-4d22-abfc-ae536c7bd97c tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:15.408614 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a9b22827-f6e8-4d22-abfc-ae536c7bd97c tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:15.468891 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-04dd6b11-80e5-4978-9c23-11a527d823da tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] Calling method '.version_select at 0x7f8d69472ca0>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:15.470827 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-a9b22827-f6e8-4d22-abfc-ae536c7bd97c tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:15.479084 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-a9b22827-f6e8-4d22-abfc-ae536c7bd97c tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37" status: 200 len: 1222 microversion: 2.1 time: 0.084275 Aug 09 18:56:15.479740 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 409/845] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:15 2022] GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:56:15.501024 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-04dd6b11-80e5-4978-9c23-11a527d823da tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/6b84c337-d462-4d14-9500-9efe40f3e22e" status: 200 len: 287 microversion: 2.1 time: 0.035937 Aug 09 18:56:15.501834 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 437/846] 10.222.0.57 () {58 vars in 1251 bytes} [Tue Aug 9 18:56:15 2022] GET /compute/v2.1/os-snapshots/6b84c337-d462-4d14-9500-9efe40f3e22e => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:56:15.513294 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-1ffaa786-2de5-4851-a919-9fa281e05a17 tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] Calling method '.version_select at 0x7f8d6a830280>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:15.521316 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5c0b17af-195f-465c-9f19-3f6aac10c552 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:15.522504 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-5c0b17af-195f-465c-9f19-3f6aac10c552 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:15.539834 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5c0b17af-195f-465c-9f19-3f6aac10c552 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:15.539834 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5c0b17af-195f-465c-9f19-3f6aac10c552 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:15.539834 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5c0b17af-195f-465c-9f19-3f6aac10c552 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:15.539834 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5c0b17af-195f-465c-9f19-3f6aac10c552 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:15.540292 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5c0b17af-195f-465c-9f19-3f6aac10c552 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:15.540292 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5c0b17af-195f-465c-9f19-3f6aac10c552 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:15.598091 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5c0b17af-195f-465c-9f19-3f6aac10c552 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:15.605469 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-5c0b17af-195f-465c-9f19-3f6aac10c552 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1263 microversion: 2.1 time: 0.089349 Aug 09 18:56:15.606075 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 438/847] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:15 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1263 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:56:15.662274 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-1ffaa786-2de5-4851-a919-9fa281e05a17 tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] 10.222.0.57 "DELETE /compute/v2.1/os-snapshots/6b84c337-d462-4d14-9500-9efe40f3e22e" status: 202 len: 0 microversion: 2.1 time: 0.152677 Aug 09 18:56:15.666061 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 410/848] 10.222.0.57 () {58 vars in 1254 bytes} [Tue Aug 9 18:56:15 2022] DELETE /compute/v2.1/os-snapshots/6b84c337-d462-4d14-9500-9efe40f3e22e => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:56:15.671850 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-fa4e57be-e889-47f8-9808-23eeef172ec5 tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] Calling method '.version_select at 0x7f8d69432430>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:15.715188 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-fa4e57be-e889-47f8-9808-23eeef172ec5 tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/6b84c337-d462-4d14-9500-9efe40f3e22e" status: 200 len: 286 microversion: 2.1 time: 0.047417 Aug 09 18:56:15.715838 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 439/849] 10.222.0.57 () {58 vars in 1251 bytes} [Tue Aug 9 18:56:15 2022] GET /compute/v2.1/os-snapshots/6b84c337-d462-4d14-9500-9efe40f3e22e => generated 286 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:56:16.224421 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-b322e560-0dcb-467c-af1c-5664edac1e52 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:16.226655 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-b322e560-0dcb-467c-af1c-5664edac1e52 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: f349cf3d-5117-4617-ad83-8c0cc44f5bd5] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:16.232643 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b322e560-0dcb-467c-af1c-5664edac1e52 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:16.233110 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b322e560-0dcb-467c-af1c-5664edac1e52 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:16.233556 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b322e560-0dcb-467c-af1c-5664edac1e52 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:16.234239 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b322e560-0dcb-467c-af1c-5664edac1e52 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:16.234684 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b322e560-0dcb-467c-af1c-5664edac1e52 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:16.235098 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b322e560-0dcb-467c-af1c-5664edac1e52 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:16.265436 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-b322e560-0dcb-467c-af1c-5664edac1e52 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044852 Aug 09 18:56:16.266345 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 411/850] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 9 18:56:16 2022] GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 18:56:16.331440 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-647d0a0b-e61a-40e7-b783-0208a4b8f85b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:16.331933 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-647d0a0b-e61a-40e7-b783-0208a4b8f85b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: f349cf3d-5117-4617-ad83-8c0cc44f5bd5] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:16.338112 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-647d0a0b-e61a-40e7-b783-0208a4b8f85b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:16.338605 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-647d0a0b-e61a-40e7-b783-0208a4b8f85b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:16.339033 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-647d0a0b-e61a-40e7-b783-0208a4b8f85b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:16.339757 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-647d0a0b-e61a-40e7-b783-0208a4b8f85b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:16.340207 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-647d0a0b-e61a-40e7-b783-0208a4b8f85b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:16.340625 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-647d0a0b-e61a-40e7-b783-0208a4b8f85b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:16.366217 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-647d0a0b-e61a-40e7-b783-0208a4b8f85b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: f349cf3d-5117-4617-ad83-8c0cc44f5bd5] Going to try to terminate instance {{(pid=124725) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:56:16.500563 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-17d8169e-2d4e-45bb-b925-8a49ea08a529 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:16.501180 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-17d8169e-2d4e-45bb-b925-8a49ea08a529 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:16.508088 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-17d8169e-2d4e-45bb-b925-8a49ea08a529 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:16.508573 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-17d8169e-2d4e-45bb-b925-8a49ea08a529 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:16.509175 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-17d8169e-2d4e-45bb-b925-8a49ea08a529 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:16.510066 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-17d8169e-2d4e-45bb-b925-8a49ea08a529 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:16.510581 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-17d8169e-2d4e-45bb-b925-8a49ea08a529 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:16.511009 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-17d8169e-2d4e-45bb-b925-8a49ea08a529 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:16.588246 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-17d8169e-2d4e-45bb-b925-8a49ea08a529 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:16.595777 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-17d8169e-2d4e-45bb-b925-8a49ea08a529 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37" status: 200 len: 1278 microversion: 2.1 time: 0.099782 Aug 09 18:56:16.596349 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 412/851] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:16 2022] GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37 => generated 1278 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:56:16.634133 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-a4c88c51-fe05-4adc-a75a-d91033b45471 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:16.636416 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-a4c88c51-fe05-4adc-a75a-d91033b45471 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:16.647103 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a4c88c51-fe05-4adc-a75a-d91033b45471 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:16.648404 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a4c88c51-fe05-4adc-a75a-d91033b45471 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:16.648858 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a4c88c51-fe05-4adc-a75a-d91033b45471 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:16.650288 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a4c88c51-fe05-4adc-a75a-d91033b45471 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:16.650288 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a4c88c51-fe05-4adc-a75a-d91033b45471 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:16.650902 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a4c88c51-fe05-4adc-a75a-d91033b45471 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:16.710665 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-647d0a0b-e61a-40e7-b783-0208a4b8f85b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5" status: 204 len: 0 microversion: 2.1 time: 0.382857 Aug 09 18:56:16.711350 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 440/852] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 9 18:56:16 2022] DELETE /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:56:16.719754 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-434042ab-1147-4f5f-ac4a-28e51140ab43 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:16.720440 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-434042ab-1147-4f5f-ac4a-28e51140ab43 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: f349cf3d-5117-4617-ad83-8c0cc44f5bd5] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:16.727265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-434042ab-1147-4f5f-ac4a-28e51140ab43 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:16.727746 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-434042ab-1147-4f5f-ac4a-28e51140ab43 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:16.728173 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-434042ab-1147-4f5f-ac4a-28e51140ab43 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:16.728865 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-434042ab-1147-4f5f-ac4a-28e51140ab43 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:16.729311 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-434042ab-1147-4f5f-ac4a-28e51140ab43 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:16.729761 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-434042ab-1147-4f5f-ac4a-28e51140ab43 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:16.773765 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-a4c88c51-fe05-4adc-a75a-d91033b45471 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:16.784086 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-a4c88c51-fe05-4adc-a75a-d91033b45471 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1319 microversion: 2.1 time: 0.155691 Aug 09 18:56:16.785269 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 413/853] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:16 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:56:16.790295 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-1a0eb4b1-3d72-4d4f-9e26-126f66d05c29 tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] Calling method '.version_select at 0x7f8d69ca58b0>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:16.822603 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.wsgi [None req-1a0eb4b1-3d72-4d4f-9e26-126f66d05c29 tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] HTTP exception thrown: Snapshot 6b84c337-d462-4d14-9500-9efe40f3e22e could not be found. Aug 09 18:56:16.827866 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-1a0eb4b1-3d72-4d4f-9e26-126f66d05c29 tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] Request method failure captured: Aug 09 18:56:16.827866 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: request: GET /compute/v2.1/os-snapshots/6b84c337-d462-4d14-9500-9efe40f3e22e HTTP/1.1 Aug 09 18:56:16.827866 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept: application/json Aug 09 18:56:16.827866 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept-Encoding: identity Aug 09 18:56:16.827866 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Connection: close Aug 09 18:56:16.827866 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Length: 0 Aug 09 18:56:16.827866 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Type: application/json Aug 09 18:56:16.827866 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Host: 10.222.0.57 Aug 09 18:56:16.827866 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Openstack-System-Scope: None Aug 09 18:56:16.827866 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: User-Agent: python-urllib3/1.26.11 Aug 09 18:56:16.827866 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Auth-Token: gAAAAABi8q3JWmSPzrGzwJimt7TushRcMQd2vA2g5vumQbw5tKriEq_uHjA8gR_VgVCioJ42ZPLlnWug2btkcs2y18xPgCjBeD4eCPN5umXK3izJ-E3T2zY_8mQbTGgrBhfYvwjg386BWiUcPvV2c2kRhq-pXi_vM-LP2eh4-ZRSNUi7eTP1_io Aug 09 18:56:16.827866 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Id: None Aug 09 18:56:16.827866 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Name: None Aug 09 18:56:16.827866 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Identity-Status: Confirmed Aug 09 18:56:16.827866 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Is-Admin-Project: True Aug 09 18:56:16.827866 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Id: default Aug 09 18:56:16.827866 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Name: Default Aug 09 18:56:16.827866 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Id: c2d43a17af3444f48961b49b5442613f Aug 09 18:56:16.827866 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1430910656 Aug 09 18:56:16.827866 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Role: reader,member Aug 09 18:56:16.827866 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Roles: reader,member Aug 09 18:56:16.829637 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c2d43a17af3444f48961b49b5442613f", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c2d43a17af3444f48961b49b5442613f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c2d43a17af3444f48961b49b5442613f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c2d43a17af3444f48961b49b5442613f"}]}] Aug 09 18:56:16.829637 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1430910656 Aug 09 18:56:16.829637 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Id: c2d43a17af3444f48961b49b5442613f Aug 09 18:56:16.829637 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1430910656 Aug 09 18:56:16.829637 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User: tempest-VolumesSnapshotsTestJSON-1430910656-project Aug 09 18:56:16.829637 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Id: default Aug 09 18:56:16.829637 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Name: Default Aug 09 18:56:16.829637 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Id: 1c4a100a2ce140f4b39cd224ecf18c24 Aug 09 18:56:16.829637 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1430910656-project Aug 09 18:56:16.829637 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: method: Aug 09 18:56:16.829637 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: exception: Snapshot 6b84c337-d462-4d14-9500-9efe40f3e22e could not be found. Aug 09 18:56:16.829637 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: action_args: {'id': '6b84c337-d462-4d14-9500-9efe40f3e22e'} Aug 09 18:56:16.829637 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:56:16.830523 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:16.830523 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 09 18:56:16.830523 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 09 18:56:16.830523 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 09 18:56:16.830523 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 09 18:56:16.830523 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 09 18:56:16.830523 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 09 18:56:16.830523 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 18:56:16.830523 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 18:56:16.830523 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 18:56:16.830523 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 18:56:16.830523 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 18:56:16.830523 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 18:56:16.830523 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 18:56:16.830523 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 18:56:16.830523 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 6b84c337-d462-4d14-9500-9efe40f3e22e could not be found. (HTTP 404) (Request-ID: req-1f3a0db7-5526-4b0f-875a-99dafb095b8f) Aug 09 18:56:16.830523 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:16.830523 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:16.831870 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:16.831870 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:16.831870 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 09 18:56:16.831870 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 09 18:56:16.831870 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 18:56:16.831870 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 18:56:16.831870 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 09 18:56:16.831870 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 09 18:56:16.831870 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 18:56:16.831870 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 18:56:16.831870 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 09 18:56:16.831870 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 09 18:56:16.831870 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 09 18:56:16.831870 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 09 18:56:16.831870 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 09 18:56:16.831870 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 09 18:56:16.831870 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 18:56:16.831870 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 18:56:16.831870 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 18:56:16.833378 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 18:56:16.833378 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 18:56:16.833378 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 18:56:16.833378 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 18:56:16.833378 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 18:56:16.833378 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 6b84c337-d462-4d14-9500-9efe40f3e22e could not be found. Aug 09 18:56:16.833378 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:16.833378 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:16.833378 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:16.833378 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:16.833378 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:56:16.833378 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:56:16.833378 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:56:16.833378 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:56:16.833378 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 18:56:16.833378 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 18:56:16.833378 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:56:16.833378 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:56:16.833378 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 09 18:56:16.833378 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:56:16.838612 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 6b84c337-d462-4d14-9500-9efe40f3e22e could not be found. Aug 09 18:56:16.838612 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:16.838612 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:16.838612 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:16.838612 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:16.838612 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:56:16.838612 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:56:16.838612 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:56:16.838612 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:56:16.838612 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 6b84c337-d462-4d14-9500-9efe40f3e22e could not be found. Aug 09 18:56:16.838612 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:16.838612 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-1a0eb4b1-3d72-4d4f-9e26-126f66d05c29 tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] Returning 404 to user: Snapshot 6b84c337-d462-4d14-9500-9efe40f3e22e could not be found. {{(pid=124726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:56:16.838612 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-1a0eb4b1-3d72-4d4f-9e26-126f66d05c29 tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/6b84c337-d462-4d14-9500-9efe40f3e22e" status: 404 len: 111 microversion: 2.1 time: 0.048371 Aug 09 18:56:16.840113 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 414/854] 10.222.0.57 () {58 vars in 1251 bytes} [Tue Aug 9 18:56:16 2022] GET /compute/v2.1/os-snapshots/6b84c337-d462-4d14-9500-9efe40f3e22e => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:56:16.843381 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-77bc15db-6fcd-4d34-8170-9d5672503fb0 tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] Calling method '.version_select at 0x7f8d69c269d0>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:16.897606 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-434042ab-1147-4f5f-ac4a-28e51140ab43 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:16.905161 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-434042ab-1147-4f5f-ac4a-28e51140ab43 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5" status: 200 len: 1681 microversion: 2.1 time: 0.189497 Aug 09 18:56:16.905807 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 441/855] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:16 2022] GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5 => generated 1681 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:56:17.030730 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-77bc15db-6fcd-4d34-8170-9d5672503fb0 tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/5be2d5b3-feef-48eb-8922-86721d586127" status: 202 len: 0 microversion: 2.1 time: 0.190865 Aug 09 18:56:17.031334 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 415/856] 10.222.0.57 () {58 vars in 1248 bytes} [Tue Aug 9 18:56:16 2022] DELETE /compute/v2.1/os-volumes/5be2d5b3-feef-48eb-8922-86721d586127 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:56:17.040525 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-409ce3d5-4d98-44cd-9799-2a1e2302a36d tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] Calling method '.version_select at 0x7f8d694ba8b0>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:17.088945 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-409ce3d5-4d98-44cd-9799-2a1e2302a36d tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/5be2d5b3-feef-48eb-8922-86721d586127" status: 200 len: 345 microversion: 2.1 time: 0.052330 Aug 09 18:56:17.089550 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 442/857] 10.222.0.57 () {58 vars in 1245 bytes} [Tue Aug 9 18:56:17 2022] GET /compute/v2.1/os-volumes/5be2d5b3-feef-48eb-8922-86721d586127 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:56:17.617777 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-a6b36702-5ebc-43df-ae24-a5a3bc28ce37 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:17.618297 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-a6b36702-5ebc-43df-ae24-a5a3bc28ce37 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:17.624337 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a6b36702-5ebc-43df-ae24-a5a3bc28ce37 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:17.624821 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a6b36702-5ebc-43df-ae24-a5a3bc28ce37 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:17.625261 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a6b36702-5ebc-43df-ae24-a5a3bc28ce37 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:17.626177 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a6b36702-5ebc-43df-ae24-a5a3bc28ce37 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:17.626492 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a6b36702-5ebc-43df-ae24-a5a3bc28ce37 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:17.626845 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a6b36702-5ebc-43df-ae24-a5a3bc28ce37 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:17.757092 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-a6b36702-5ebc-43df-ae24-a5a3bc28ce37 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:17.764693 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-a6b36702-5ebc-43df-ae24-a5a3bc28ce37 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37" status: 200 len: 1330 microversion: 2.1 time: 0.151427 Aug 09 18:56:17.765266 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 416/858] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:17 2022] GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37 => generated 1330 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:56:17.806758 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-3a4b16d9-4112-41a8-a1bf-52eaa0e0fd46 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:17.807368 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-3a4b16d9-4112-41a8-a1bf-52eaa0e0fd46 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:17.813604 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3a4b16d9-4112-41a8-a1bf-52eaa0e0fd46 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:17.814107 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3a4b16d9-4112-41a8-a1bf-52eaa0e0fd46 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:17.814535 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3a4b16d9-4112-41a8-a1bf-52eaa0e0fd46 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:17.815219 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3a4b16d9-4112-41a8-a1bf-52eaa0e0fd46 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:17.816281 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3a4b16d9-4112-41a8-a1bf-52eaa0e0fd46 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:17.816707 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3a4b16d9-4112-41a8-a1bf-52eaa0e0fd46 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:17.880023 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-3a4b16d9-4112-41a8-a1bf-52eaa0e0fd46 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:17.887392 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-3a4b16d9-4112-41a8-a1bf-52eaa0e0fd46 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1319 microversion: 2.1 time: 0.085009 Aug 09 18:56:17.887962 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 443/859] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:17 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1319 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:56:17.927315 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-cfda13ee-b774-4901-a260-f361b8565c5e tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:17.927912 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-cfda13ee-b774-4901-a260-f361b8565c5e tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: f349cf3d-5117-4617-ad83-8c0cc44f5bd5] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:17.934096 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cfda13ee-b774-4901-a260-f361b8565c5e tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:17.934571 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cfda13ee-b774-4901-a260-f361b8565c5e tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:17.934995 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cfda13ee-b774-4901-a260-f361b8565c5e tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:17.935946 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cfda13ee-b774-4901-a260-f361b8565c5e tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:17.936389 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cfda13ee-b774-4901-a260-f361b8565c5e tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:17.936802 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cfda13ee-b774-4901-a260-f361b8565c5e tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:18.103390 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-72cf46c9-1946-4c38-95cc-87aa1ef14f66 tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] Calling method '.version_select at 0x7f8d69430f70>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:18.132611 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-72cf46c9-1946-4c38-95cc-87aa1ef14f66 tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] HTTP exception thrown: Volume 5be2d5b3-feef-48eb-8922-86721d586127 could not be found. Aug 09 18:56:18.137263 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-72cf46c9-1946-4c38-95cc-87aa1ef14f66 tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] Request method failure captured: Aug 09 18:56:18.137263 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: request: GET /compute/v2.1/os-volumes/5be2d5b3-feef-48eb-8922-86721d586127 HTTP/1.1 Aug 09 18:56:18.137263 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept: application/json Aug 09 18:56:18.137263 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Aug 09 18:56:18.137263 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Connection: close Aug 09 18:56:18.137263 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Length: 0 Aug 09 18:56:18.137263 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Type: application/json Aug 09 18:56:18.137263 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Host: 10.222.0.57 Aug 09 18:56:18.137263 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Aug 09 18:56:18.137263 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.11 Aug 09 18:56:18.137263 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABi8q3JWmSPzrGzwJimt7TushRcMQd2vA2g5vumQbw5tKriEq_uHjA8gR_VgVCioJ42ZPLlnWug2btkcs2y18xPgCjBeD4eCPN5umXK3izJ-E3T2zY_8mQbTGgrBhfYvwjg386BWiUcPvV2c2kRhq-pXi_vM-LP2eh4-ZRSNUi7eTP1_io Aug 09 18:56:18.137263 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Aug 09 18:56:18.137263 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Aug 09 18:56:18.137263 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Aug 09 18:56:18.137263 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Aug 09 18:56:18.137263 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Aug 09 18:56:18.137263 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Aug 09 18:56:18.137263 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Id: c2d43a17af3444f48961b49b5442613f Aug 09 18:56:18.137263 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1430910656 Aug 09 18:56:18.137263 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Role: reader,member Aug 09 18:56:18.137263 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Roles: reader,member Aug 09 18:56:18.138985 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c2d43a17af3444f48961b49b5442613f", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c2d43a17af3444f48961b49b5442613f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c2d43a17af3444f48961b49b5442613f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c2d43a17af3444f48961b49b5442613f"}]}] Aug 09 18:56:18.138985 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1430910656 Aug 09 18:56:18.138985 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Id: c2d43a17af3444f48961b49b5442613f Aug 09 18:56:18.138985 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1430910656 Aug 09 18:56:18.138985 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User: tempest-VolumesSnapshotsTestJSON-1430910656-project Aug 09 18:56:18.138985 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Aug 09 18:56:18.138985 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Aug 09 18:56:18.138985 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Id: 1c4a100a2ce140f4b39cd224ecf18c24 Aug 09 18:56:18.138985 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1430910656-project Aug 09 18:56:18.138985 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: method: Aug 09 18:56:18.138985 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: exception: Volume 5be2d5b3-feef-48eb-8922-86721d586127 could not be found. Aug 09 18:56:18.138985 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: action_args: {'id': '5be2d5b3-feef-48eb-8922-86721d586127'} Aug 09 18:56:18.138985 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:56:18.139950 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:18.139950 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 18:56:18.139950 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 18:56:18.139950 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 18:56:18.139950 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 18:56:18.139950 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 18:56:18.139950 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 18:56:18.139950 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 18:56:18.139950 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 18:56:18.139950 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 18:56:18.139950 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 18:56:18.139950 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 18:56:18.139950 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 18:56:18.139950 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 18:56:18.139950 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 18:56:18.139950 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5be2d5b3-feef-48eb-8922-86721d586127 could not be found. (HTTP 404) (Request-ID: req-a107c82c-cf98-42d2-8c5c-6166856c59b8) Aug 09 18:56:18.139950 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:18.139950 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:18.139950 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:18.141244 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:18.141244 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 18:56:18.141244 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 18:56:18.141244 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 18:56:18.141244 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 18:56:18.141244 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 18:56:18.141244 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 18:56:18.141244 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 18:56:18.141244 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 18:56:18.141244 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 18:56:18.141244 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 18:56:18.141244 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 18:56:18.141244 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 18:56:18.141244 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 18:56:18.141244 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 18:56:18.141244 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 18:56:18.141244 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 18:56:18.141244 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 18:56:18.141244 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 18:56:18.142629 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 18:56:18.142629 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 18:56:18.142629 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 18:56:18.142629 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 18:56:18.142629 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5be2d5b3-feef-48eb-8922-86721d586127 could not be found. Aug 09 18:56:18.142629 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:18.142629 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:18.142629 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:18.142629 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:18.142629 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:56:18.142629 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:56:18.142629 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:56:18.142629 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:56:18.142629 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 18:56:18.142629 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 18:56:18.142629 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:56:18.142629 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:56:18.142629 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 18:56:18.142629 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:56:18.143986 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5be2d5b3-feef-48eb-8922-86721d586127 could not be found. Aug 09 18:56:18.143986 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:18.143986 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:18.143986 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:18.143986 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:18.143986 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:56:18.143986 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:56:18.143986 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:56:18.143986 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:56:18.143986 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5be2d5b3-feef-48eb-8922-86721d586127 could not be found. Aug 09 18:56:18.143986 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:18.143986 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-72cf46c9-1946-4c38-95cc-87aa1ef14f66 tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] Returning 404 to user: Volume 5be2d5b3-feef-48eb-8922-86721d586127 could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:56:18.143986 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-72cf46c9-1946-4c38-95cc-87aa1ef14f66 tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/5be2d5b3-feef-48eb-8922-86721d586127" status: 404 len: 109 microversion: 2.1 time: 0.037161 Aug 09 18:56:18.143986 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 444/860] 10.222.0.57 () {58 vars in 1245 bytes} [Tue Aug 9 18:56:18 2022] GET /compute/v2.1/os-volumes/5be2d5b3-feef-48eb-8922-86721d586127 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:56:18.151004 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-682dd5a0-0467-48d0-a18b-1e11c0946bb5 tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] Calling method '.version_select at 0x7f8d69432d30>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:18.191124 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-682dd5a0-0467-48d0-a18b-1e11c0946bb5 tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] HTTP exception thrown: Volume 5be2d5b3-feef-48eb-8922-86721d586127 could not be found. Aug 09 18:56:18.193369 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-682dd5a0-0467-48d0-a18b-1e11c0946bb5 tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] Request method failure captured: Aug 09 18:56:18.193369 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: request: DELETE /compute/v2.1/os-volumes/5be2d5b3-feef-48eb-8922-86721d586127 HTTP/1.1 Aug 09 18:56:18.193369 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept: application/json Aug 09 18:56:18.193369 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Aug 09 18:56:18.193369 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Connection: close Aug 09 18:56:18.193369 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Length: 0 Aug 09 18:56:18.193369 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Type: application/json Aug 09 18:56:18.193369 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Host: 10.222.0.57 Aug 09 18:56:18.193369 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Aug 09 18:56:18.193369 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.11 Aug 09 18:56:18.193369 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABi8q3JWmSPzrGzwJimt7TushRcMQd2vA2g5vumQbw5tKriEq_uHjA8gR_VgVCioJ42ZPLlnWug2btkcs2y18xPgCjBeD4eCPN5umXK3izJ-E3T2zY_8mQbTGgrBhfYvwjg386BWiUcPvV2c2kRhq-pXi_vM-LP2eh4-ZRSNUi7eTP1_io Aug 09 18:56:18.193369 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Aug 09 18:56:18.193369 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Aug 09 18:56:18.193369 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Aug 09 18:56:18.193369 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Aug 09 18:56:18.193369 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Aug 09 18:56:18.193369 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Aug 09 18:56:18.193369 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Id: c2d43a17af3444f48961b49b5442613f Aug 09 18:56:18.193369 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1430910656 Aug 09 18:56:18.193369 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Role: reader,member Aug 09 18:56:18.193369 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Roles: reader,member Aug 09 18:56:18.200256 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c2d43a17af3444f48961b49b5442613f", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c2d43a17af3444f48961b49b5442613f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c2d43a17af3444f48961b49b5442613f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c2d43a17af3444f48961b49b5442613f"}]}] Aug 09 18:56:18.200256 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1430910656 Aug 09 18:56:18.200256 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Id: c2d43a17af3444f48961b49b5442613f Aug 09 18:56:18.200256 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1430910656 Aug 09 18:56:18.200256 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User: tempest-VolumesSnapshotsTestJSON-1430910656-project Aug 09 18:56:18.200256 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Aug 09 18:56:18.200256 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Aug 09 18:56:18.200256 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Id: 1c4a100a2ce140f4b39cd224ecf18c24 Aug 09 18:56:18.200256 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1430910656-project Aug 09 18:56:18.200256 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: method: Aug 09 18:56:18.200256 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: exception: Volume 5be2d5b3-feef-48eb-8922-86721d586127 could not be found. Aug 09 18:56:18.200256 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: action_args: {'id': '5be2d5b3-feef-48eb-8922-86721d586127'} Aug 09 18:56:18.200256 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:56:18.201236 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:18.201236 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 18:56:18.201236 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 18:56:18.201236 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 18:56:18.201236 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 18:56:18.201236 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 18:56:18.201236 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 18:56:18.201236 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 18:56:18.201236 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 18:56:18.201236 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 18:56:18.201236 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 18:56:18.201236 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 18:56:18.201236 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 18:56:18.201236 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 18:56:18.201236 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 18:56:18.201236 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5be2d5b3-feef-48eb-8922-86721d586127 could not be found. (HTTP 404) (Request-ID: req-0162fed0-dd40-4463-93d7-29191b8aa396) Aug 09 18:56:18.201236 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:18.201236 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:18.201236 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:18.202679 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:18.202679 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 09 18:56:18.202679 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 09 18:56:18.202679 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 18:56:18.202679 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 18:56:18.202679 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 18:56:18.202679 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 18:56:18.202679 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 18:56:18.202679 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 18:56:18.202679 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 18:56:18.202679 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 18:56:18.202679 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 18:56:18.202679 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 18:56:18.202679 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 18:56:18.202679 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 18:56:18.202679 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 18:56:18.202679 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 18:56:18.202679 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 18:56:18.202679 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 18:56:18.204676 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 18:56:18.204676 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 18:56:18.204676 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 18:56:18.204676 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 18:56:18.204676 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5be2d5b3-feef-48eb-8922-86721d586127 could not be found. Aug 09 18:56:18.204676 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:18.204676 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:18.204676 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:18.204676 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:18.204676 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:56:18.204676 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:56:18.204676 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:56:18.204676 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:56:18.204676 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 18:56:18.204676 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 18:56:18.204676 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:56:18.204676 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:56:18.204676 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 09 18:56:18.204676 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:56:18.206197 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5be2d5b3-feef-48eb-8922-86721d586127 could not be found. Aug 09 18:56:18.206197 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:18.206197 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:18.206197 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:18.206197 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:18.206197 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:56:18.206197 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:56:18.206197 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:56:18.206197 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:56:18.206197 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5be2d5b3-feef-48eb-8922-86721d586127 could not be found. Aug 09 18:56:18.206197 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:18.206197 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-682dd5a0-0467-48d0-a18b-1e11c0946bb5 tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] Returning 404 to user: Volume 5be2d5b3-feef-48eb-8922-86721d586127 could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:56:18.206197 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-682dd5a0-0467-48d0-a18b-1e11c0946bb5 tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/5be2d5b3-feef-48eb-8922-86721d586127" status: 404 len: 109 microversion: 2.1 time: 0.049186 Aug 09 18:56:18.206197 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 445/861] 10.222.0.57 () {58 vars in 1248 bytes} [Tue Aug 9 18:56:18 2022] DELETE /compute/v2.1/os-volumes/5be2d5b3-feef-48eb-8922-86721d586127 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:56:18.212620 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-bd1ae4a8-5660-4f7b-b83f-c64131800070 tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] Calling method '.version_select at 0x7f8d694308b0>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:18.244228 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-bd1ae4a8-5660-4f7b-b83f-c64131800070 tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] HTTP exception thrown: Volume 5be2d5b3-feef-48eb-8922-86721d586127 could not be found. Aug 09 18:56:18.246846 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-bd1ae4a8-5660-4f7b-b83f-c64131800070 tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] Request method failure captured: Aug 09 18:56:18.246846 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: request: GET /compute/v2.1/os-volumes/5be2d5b3-feef-48eb-8922-86721d586127 HTTP/1.1 Aug 09 18:56:18.246846 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept: application/json Aug 09 18:56:18.246846 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Aug 09 18:56:18.246846 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Connection: close Aug 09 18:56:18.246846 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Length: 0 Aug 09 18:56:18.246846 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Type: application/json Aug 09 18:56:18.246846 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Host: 10.222.0.57 Aug 09 18:56:18.246846 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Aug 09 18:56:18.246846 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.11 Aug 09 18:56:18.246846 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABi8q3JWmSPzrGzwJimt7TushRcMQd2vA2g5vumQbw5tKriEq_uHjA8gR_VgVCioJ42ZPLlnWug2btkcs2y18xPgCjBeD4eCPN5umXK3izJ-E3T2zY_8mQbTGgrBhfYvwjg386BWiUcPvV2c2kRhq-pXi_vM-LP2eh4-ZRSNUi7eTP1_io Aug 09 18:56:18.246846 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Aug 09 18:56:18.246846 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Aug 09 18:56:18.246846 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Aug 09 18:56:18.246846 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Aug 09 18:56:18.246846 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Aug 09 18:56:18.246846 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Aug 09 18:56:18.246846 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Id: c2d43a17af3444f48961b49b5442613f Aug 09 18:56:18.246846 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1430910656 Aug 09 18:56:18.246846 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Role: reader,member Aug 09 18:56:18.246846 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Roles: reader,member Aug 09 18:56:18.248231 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c2d43a17af3444f48961b49b5442613f", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c2d43a17af3444f48961b49b5442613f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c2d43a17af3444f48961b49b5442613f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c2d43a17af3444f48961b49b5442613f"}]}] Aug 09 18:56:18.248231 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1430910656 Aug 09 18:56:18.248231 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Id: c2d43a17af3444f48961b49b5442613f Aug 09 18:56:18.248231 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1430910656 Aug 09 18:56:18.248231 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User: tempest-VolumesSnapshotsTestJSON-1430910656-project Aug 09 18:56:18.248231 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Aug 09 18:56:18.248231 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Aug 09 18:56:18.248231 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Id: 1c4a100a2ce140f4b39cd224ecf18c24 Aug 09 18:56:18.248231 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1430910656-project Aug 09 18:56:18.248231 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: method: Aug 09 18:56:18.248231 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: exception: Volume 5be2d5b3-feef-48eb-8922-86721d586127 could not be found. Aug 09 18:56:18.248231 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: action_args: {'id': '5be2d5b3-feef-48eb-8922-86721d586127'} Aug 09 18:56:18.248231 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:56:18.249056 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:18.249056 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 18:56:18.249056 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 18:56:18.249056 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 18:56:18.249056 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 18:56:18.249056 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 18:56:18.249056 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 18:56:18.249056 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 18:56:18.249056 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 18:56:18.249056 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 18:56:18.249056 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 18:56:18.249056 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 18:56:18.249056 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 18:56:18.249056 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 18:56:18.249056 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 18:56:18.249056 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5be2d5b3-feef-48eb-8922-86721d586127 could not be found. (HTTP 404) (Request-ID: req-a0323886-6675-4253-8a8e-7455ec36aa96) Aug 09 18:56:18.249056 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:18.249056 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:18.249056 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:18.250257 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:18.250257 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 18:56:18.250257 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 18:56:18.250257 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 18:56:18.250257 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 18:56:18.250257 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 18:56:18.250257 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 18:56:18.250257 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 18:56:18.250257 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 18:56:18.250257 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 18:56:18.250257 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 18:56:18.250257 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 18:56:18.250257 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 18:56:18.250257 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 18:56:18.250257 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 18:56:18.250257 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 18:56:18.250257 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 18:56:18.250257 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 18:56:18.250257 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 18:56:18.251545 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 18:56:18.251545 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 18:56:18.251545 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 18:56:18.251545 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 18:56:18.251545 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5be2d5b3-feef-48eb-8922-86721d586127 could not be found. Aug 09 18:56:18.251545 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:18.251545 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:18.251545 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:18.251545 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:18.251545 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:56:18.251545 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:56:18.251545 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:56:18.251545 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:56:18.251545 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 18:56:18.251545 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 18:56:18.251545 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:56:18.251545 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:56:18.251545 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 18:56:18.251545 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:56:18.252706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5be2d5b3-feef-48eb-8922-86721d586127 could not be found. Aug 09 18:56:18.252706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:18.252706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:18.252706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:18.252706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:18.252706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:56:18.252706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:56:18.252706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:56:18.252706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:56:18.252706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5be2d5b3-feef-48eb-8922-86721d586127 could not be found. Aug 09 18:56:18.252706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:18.252706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-bd1ae4a8-5660-4f7b-b83f-c64131800070 tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] Returning 404 to user: Volume 5be2d5b3-feef-48eb-8922-86721d586127 could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:56:18.263025 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-bd1ae4a8-5660-4f7b-b83f-c64131800070 tempest-VolumesSnapshotsTestJSON-1430910656 tempest-VolumesSnapshotsTestJSON-1430910656-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/5be2d5b3-feef-48eb-8922-86721d586127" status: 404 len: 109 microversion: 2.1 time: 0.049969 Aug 09 18:56:18.263631 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 446/862] 10.222.0.57 () {58 vars in 1245 bytes} [Tue Aug 9 18:56:18 2022] GET /compute/v2.1/os-volumes/5be2d5b3-feef-48eb-8922-86721d586127 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:56:18.281509 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-cfda13ee-b774-4901-a260-f361b8565c5e tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:18.290627 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-cfda13ee-b774-4901-a260-f361b8565c5e tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5" status: 200 len: 1681 microversion: 2.1 time: 0.367437 Aug 09 18:56:18.305455 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 417/863] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:17 2022] GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5 => generated 1681 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:56:18.787247 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-9d2151ba-d7d4-4344-bd16-7e7814446473 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:18.788771 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-9d2151ba-d7d4-4344-bd16-7e7814446473 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:18.796268 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9d2151ba-d7d4-4344-bd16-7e7814446473 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:18.797122 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9d2151ba-d7d4-4344-bd16-7e7814446473 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:18.797806 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9d2151ba-d7d4-4344-bd16-7e7814446473 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:18.798750 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9d2151ba-d7d4-4344-bd16-7e7814446473 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:18.799620 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9d2151ba-d7d4-4344-bd16-7e7814446473 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:18.800756 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9d2151ba-d7d4-4344-bd16-7e7814446473 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:18.908546 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-9e297762-1a7c-42c5-94e8-b6887d48f370 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:18.909279 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-9e297762-1a7c-42c5-94e8-b6887d48f370 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:18.920395 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9e297762-1a7c-42c5-94e8-b6887d48f370 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:18.926390 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9e297762-1a7c-42c5-94e8-b6887d48f370 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:18.926921 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9e297762-1a7c-42c5-94e8-b6887d48f370 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:18.927807 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9e297762-1a7c-42c5-94e8-b6887d48f370 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:18.928350 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9e297762-1a7c-42c5-94e8-b6887d48f370 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:18.928846 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9e297762-1a7c-42c5-94e8-b6887d48f370 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:19.141451 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-9e297762-1a7c-42c5-94e8-b6887d48f370 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:19.155655 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-9e297762-1a7c-42c5-94e8-b6887d48f370 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1317 microversion: 2.1 time: 0.250134 Aug 09 18:56:19.159983 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 418/864] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:18 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1317 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:56:19.313459 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-b97b289b-21e1-43b0-bb3f-2d51f2717027 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:19.314250 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-b97b289b-21e1-43b0-bb3f-2d51f2717027 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: f349cf3d-5117-4617-ad83-8c0cc44f5bd5] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:19.321881 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b97b289b-21e1-43b0-bb3f-2d51f2717027 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:19.327489 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b97b289b-21e1-43b0-bb3f-2d51f2717027 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:19.327489 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b97b289b-21e1-43b0-bb3f-2d51f2717027 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:19.327489 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b97b289b-21e1-43b0-bb3f-2d51f2717027 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:19.327489 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b97b289b-21e1-43b0-bb3f-2d51f2717027 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:19.327828 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b97b289b-21e1-43b0-bb3f-2d51f2717027 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:19.370788 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-9d2151ba-d7d4-4344-bd16-7e7814446473 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:19.379063 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-9d2151ba-d7d4-4344-bd16-7e7814446473 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37" status: 200 len: 1318 microversion: 2.1 time: 0.595679 Aug 09 18:56:19.379644 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 447/865] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:18 2022] GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37 => generated 1318 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:56:19.638397 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-e3f7f760-59bb-4def-a865-8f505fffc394 req-e1d367b3-556b-4a12-9f89-23724df1e1e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9eb9fbf1-ba64-43ee-ab55-edb2768a4b37", "tag": "230a82b6-3ab2-44cc-98a7-09411b537bb9"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:56:19.684229 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-e3f7f760-59bb-4def-a865-8f505fffc394 req-e1d367b3-556b-4a12-9f89-23724df1e1e4 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:19.685085 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-e3f7f760-59bb-4def-a865-8f505fffc394 req-e1d367b3-556b-4a12-9f89-23724df1e1e4 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:19.685993 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-e3f7f760-59bb-4def-a865-8f505fffc394 req-e1d367b3-556b-4a12-9f89-23724df1e1e4 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:19.718462 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-e3f7f760-59bb-4def-a865-8f505fffc394 req-e1d367b3-556b-4a12-9f89-23724df1e1e4 service nova] Creating event network-changed:230a82b6-3ab2-44cc-98a7-09411b537bb9 for instance 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37 on hv-cinder-82660 Aug 09 18:56:19.725456 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-e3f7f760-59bb-4def-a865-8f505fffc394 req-e1d367b3-556b-4a12-9f89-23724df1e1e4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092426 Aug 09 18:56:19.730464 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 448/866] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:56:19.805689 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-b97b289b-21e1-43b0-bb3f-2d51f2717027 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:19.822127 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-b97b289b-21e1-43b0-bb3f-2d51f2717027 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5" status: 200 len: 1681 microversion: 2.1 time: 0.505311 Aug 09 18:56:19.822127 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 419/867] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:19 2022] GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5 => generated 1681 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:56:20.134671 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-9cae88a8-e07b-4ff8-8c3a-702d66ee5d60 req-1d4664a0-1e24-4c4e-8247-009da2fcee87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f349cf3d-5117-4617-ad83-8c0cc44f5bd5", "name": "network-vif-deleted", "tag": "7c846f90-8370-4cf7-affb-6469e7219d6f"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:56:20.162667 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-9cae88a8-e07b-4ff8-8c3a-702d66ee5d60 req-1d4664a0-1e24-4c4e-8247-009da2fcee87 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:20.163173 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-9cae88a8-e07b-4ff8-8c3a-702d66ee5d60 req-1d4664a0-1e24-4c4e-8247-009da2fcee87 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:20.163595 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-9cae88a8-e07b-4ff8-8c3a-702d66ee5d60 req-1d4664a0-1e24-4c4e-8247-009da2fcee87 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:20.178708 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-9cae88a8-e07b-4ff8-8c3a-702d66ee5d60 req-1d4664a0-1e24-4c4e-8247-009da2fcee87 service nova] Creating event network-vif-deleted:7c846f90-8370-4cf7-affb-6469e7219d6f for instance f349cf3d-5117-4617-ad83-8c0cc44f5bd5 on hv-cinder-82660 Aug 09 18:56:20.181214 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-e0cf9b0f-c67e-4917-ab40-33f99d751e51 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:20.181856 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-e0cf9b0f-c67e-4917-ab40-33f99d751e51 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:20.186223 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-9cae88a8-e07b-4ff8-8c3a-702d66ee5d60 req-1d4664a0-1e24-4c4e-8247-009da2fcee87 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055298 Aug 09 18:56:20.186623 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 449/868] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:56:20.197548 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e0cf9b0f-c67e-4917-ab40-33f99d751e51 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:20.204870 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e0cf9b0f-c67e-4917-ab40-33f99d751e51 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:20.204870 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e0cf9b0f-c67e-4917-ab40-33f99d751e51 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:20.204870 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e0cf9b0f-c67e-4917-ab40-33f99d751e51 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:20.210192 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e0cf9b0f-c67e-4917-ab40-33f99d751e51 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:20.211343 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e0cf9b0f-c67e-4917-ab40-33f99d751e51 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:20.403014 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d87013e3-d48a-4470-95d9-e57eed48aace tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:20.405738 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-d87013e3-d48a-4470-95d9-e57eed48aace tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:20.415342 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d87013e3-d48a-4470-95d9-e57eed48aace tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:20.421008 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d87013e3-d48a-4470-95d9-e57eed48aace tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:20.421445 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d87013e3-d48a-4470-95d9-e57eed48aace tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:20.422900 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d87013e3-d48a-4470-95d9-e57eed48aace tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:20.423519 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d87013e3-d48a-4470-95d9-e57eed48aace tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:20.425221 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d87013e3-d48a-4470-95d9-e57eed48aace tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:20.655996 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d87013e3-d48a-4470-95d9-e57eed48aace tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:20.676723 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-d87013e3-d48a-4470-95d9-e57eed48aace tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37" status: 200 len: 1318 microversion: 2.1 time: 0.275285 Aug 09 18:56:20.676723 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 450/869] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:20 2022] GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37 => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:56:20.751445 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-e0cf9b0f-c67e-4917-ab40-33f99d751e51 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:20.763762 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-e0cf9b0f-c67e-4917-ab40-33f99d751e51 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1359 microversion: 2.1 time: 0.586942 Aug 09 18:56:20.770679 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 420/870] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:20 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1359 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:56:20.836100 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-8ac2ff19-eb52-44da-ae98-444d359a7464 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:20.836806 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-8ac2ff19-eb52-44da-ae98-444d359a7464 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: f349cf3d-5117-4617-ad83-8c0cc44f5bd5] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:20.844011 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8ac2ff19-eb52-44da-ae98-444d359a7464 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:20.844895 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8ac2ff19-eb52-44da-ae98-444d359a7464 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:20.845582 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8ac2ff19-eb52-44da-ae98-444d359a7464 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:20.846530 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8ac2ff19-eb52-44da-ae98-444d359a7464 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:20.847338 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8ac2ff19-eb52-44da-ae98-444d359a7464 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:20.848059 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8ac2ff19-eb52-44da-ae98-444d359a7464 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:20.912755 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8ac2ff19-eb52-44da-ae98-444d359a7464 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:20.923925 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8ac2ff19-eb52-44da-ae98-444d359a7464 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:20.925333 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8ac2ff19-eb52-44da-ae98-444d359a7464 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:20.927143 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.objects.instance [None req-8ac2ff19-eb52-44da-ae98-444d359a7464 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lazy-loading 'fault' on Instance uuid f349cf3d-5117-4617-ad83-8c0cc44f5bd5 {{(pid=124725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:56:21.018253 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-8ac2ff19-eb52-44da-ae98-444d359a7464 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:21.027000 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-8ac2ff19-eb52-44da-ae98-444d359a7464 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5" status: 200 len: 1331 microversion: 2.1 time: 0.194826 Aug 09 18:56:21.033861 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 451/871] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:20 2022] GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5 => generated 1331 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:56:21.705611 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-3a52367b-2da8-4030-b734-387b03eedaf0 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:21.708088 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-3a52367b-2da8-4030-b734-387b03eedaf0 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:21.733923 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3a52367b-2da8-4030-b734-387b03eedaf0 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:21.735085 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3a52367b-2da8-4030-b734-387b03eedaf0 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:21.735827 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3a52367b-2da8-4030-b734-387b03eedaf0 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:21.739069 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3a52367b-2da8-4030-b734-387b03eedaf0 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:21.740263 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3a52367b-2da8-4030-b734-387b03eedaf0 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:21.740875 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3a52367b-2da8-4030-b734-387b03eedaf0 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:21.798325 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d58752d4-437c-41a2-9fa9-e49caf40ea87 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:21.799120 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-d58752d4-437c-41a2-9fa9-e49caf40ea87 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:21.813246 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d58752d4-437c-41a2-9fa9-e49caf40ea87 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:21.813953 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d58752d4-437c-41a2-9fa9-e49caf40ea87 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:21.814643 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d58752d4-437c-41a2-9fa9-e49caf40ea87 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:21.816576 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d58752d4-437c-41a2-9fa9-e49caf40ea87 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:21.822328 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d58752d4-437c-41a2-9fa9-e49caf40ea87 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:21.823025 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d58752d4-437c-41a2-9fa9-e49caf40ea87 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:21.910245 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell0:SELECT=2 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:56:22.051734 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d58752d4-437c-41a2-9fa9-e49caf40ea87 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:22.062713 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-d58752d4-437c-41a2-9fa9-e49caf40ea87 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1359 microversion: 2.1 time: 0.268885 Aug 09 18:56:22.063554 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 452/872] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:21 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1359 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:56:22.086825 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-49ecd472-afdd-4a96-a342-887124bd38cb req-6ad245a1-a70f-4f50-98fe-aa3111ea98fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62994491-4240-4199-9ae0-b9ac533e3212", "tag": "d042031b-a302-4388-99a8-e8c5cc484000"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:56:22.099987 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-49ecd472-afdd-4a96-a342-887124bd38cb req-6ad245a1-a70f-4f50-98fe-aa3111ea98fe service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:22.101755 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-49ecd472-afdd-4a96-a342-887124bd38cb req-6ad245a1-a70f-4f50-98fe-aa3111ea98fe service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:22.102668 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-49ecd472-afdd-4a96-a342-887124bd38cb req-6ad245a1-a70f-4f50-98fe-aa3111ea98fe service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:22.119695 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-49ecd472-afdd-4a96-a342-887124bd38cb req-6ad245a1-a70f-4f50-98fe-aa3111ea98fe service nova] Creating event network-changed:d042031b-a302-4388-99a8-e8c5cc484000 for instance 62994491-4240-4199-9ae0-b9ac533e3212 on hv-cinder-82660 Aug 09 18:56:22.127313 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-49ecd472-afdd-4a96-a342-887124bd38cb req-6ad245a1-a70f-4f50-98fe-aa3111ea98fe service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045257 Aug 09 18:56:22.129364 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 453/873] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:56:22.144575 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-eb2e0f09-0374-4824-9cf7-7b940ea6534b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:22.146451 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-eb2e0f09-0374-4824-9cf7-7b940ea6534b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: f349cf3d-5117-4617-ad83-8c0cc44f5bd5] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:22.161799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-eb2e0f09-0374-4824-9cf7-7b940ea6534b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:22.162616 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-eb2e0f09-0374-4824-9cf7-7b940ea6534b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:22.163596 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-eb2e0f09-0374-4824-9cf7-7b940ea6534b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:22.165465 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-eb2e0f09-0374-4824-9cf7-7b940ea6534b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:22.165984 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-eb2e0f09-0374-4824-9cf7-7b940ea6534b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:22.166422 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-eb2e0f09-0374-4824-9cf7-7b940ea6534b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:22.272786 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-3a52367b-2da8-4030-b734-387b03eedaf0 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:22.283571 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-3a52367b-2da8-4030-b734-387b03eedaf0 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37" status: 200 len: 1318 microversion: 2.1 time: 0.585053 Aug 09 18:56:22.284221 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 421/874] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:21 2022] GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37 => generated 1318 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:56:22.320686 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-eb2e0f09-0374-4824-9cf7-7b940ea6534b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:22.321229 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-eb2e0f09-0374-4824-9cf7-7b940ea6534b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:22.322474 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-eb2e0f09-0374-4824-9cf7-7b940ea6534b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:22.322928 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.objects.instance [None req-eb2e0f09-0374-4824-9cf7-7b940ea6534b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lazy-loading 'fault' on Instance uuid f349cf3d-5117-4617-ad83-8c0cc44f5bd5 {{(pid=124725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:56:22.416413 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-eb2e0f09-0374-4824-9cf7-7b940ea6534b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00491255f4b44125b6dc9f816c9bbb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a745db383cb452187f7c82b9977c09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:22.428772 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-eb2e0f09-0374-4824-9cf7-7b940ea6534b tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5" status: 200 len: 1331 microversion: 2.1 time: 0.297476 Aug 09 18:56:22.441631 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 454/875] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:22 2022] GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5 => generated 1331 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:56:22.622340 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-5dcb8a06-d567-45ee-af8a-15fc740e2c48 tempest-VolumesNegativeTest-507951958 tempest-VolumesNegativeTest-507951958-project] Action: 'create', calling method: .version_select at 0x7f8d69ddeca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-822820483", "metadata": {"Type": "work"}}} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:56:22.641365 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-5dcb8a06-d567-45ee-af8a-15fc740e2c48 tempest-VolumesNegativeTest-507951958 tempest-VolumesNegativeTest-507951958-project] Request method failure captured: Aug 09 18:56:22.641365 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 09 18:56:22.641365 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept: application/json Aug 09 18:56:22.641365 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept-Encoding: identity Aug 09 18:56:22.641365 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Connection: close Aug 09 18:56:22.641365 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Length: 121 Aug 09 18:56:22.641365 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Type: application/json Aug 09 18:56:22.641365 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Host: 10.222.0.57 Aug 09 18:56:22.641365 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Openstack-System-Scope: None Aug 09 18:56:22.641365 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: User-Agent: python-urllib3/1.26.11 Aug 09 18:56:22.641365 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Auth-Token: gAAAAABi8q3WKxoNRDc-71Pi6JRfaSmMJ1dWa9PdkK_HrsHAomSQOk4S2oh5lNzisdx7RB06sN8GWwng8luLutrxUicRxfXmi8rG2VkzXTk9-GtT2Bc64cU1-8OP3F4ZH3-rZRBGBCmzR1mbSzzLTlL8GcHIZx-rmYGXvtN7riWr04Z9OAzcCfQ Aug 09 18:56:22.641365 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Id: None Aug 09 18:56:22.641365 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Name: None Aug 09 18:56:22.641365 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Identity-Status: Confirmed Aug 09 18:56:22.641365 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Is-Admin-Project: True Aug 09 18:56:22.641365 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Id: default Aug 09 18:56:22.641365 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Name: Default Aug 09 18:56:22.641365 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Id: 5460728e12e748eeab5f345b25177f62 Aug 09 18:56:22.641365 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Name: tempest-VolumesNegativeTest-507951958 Aug 09 18:56:22.641365 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Role: reader,member Aug 09 18:56:22.641365 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Roles: reader,member Aug 09 18:56:22.646140 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5460728e12e748eeab5f345b25177f62", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5460728e12e748eeab5f345b25177f62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5460728e12e748eeab5f345b25177f62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5460728e12e748eeab5f345b25177f62"}]}] Aug 09 18:56:22.646140 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant: tempest-VolumesNegativeTest-507951958 Aug 09 18:56:22.646140 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Id: 5460728e12e748eeab5f345b25177f62 Aug 09 18:56:22.646140 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Name: tempest-VolumesNegativeTest-507951958 Aug 09 18:56:22.646140 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User: tempest-VolumesNegativeTest-507951958-project Aug 09 18:56:22.646140 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Id: default Aug 09 18:56:22.646140 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Name: Default Aug 09 18:56:22.646140 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Id: 653103ee529a4f4c8e72b0bc9be5df13 Aug 09 18:56:22.646140 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Name: tempest-VolumesNegativeTest-507951958-project Aug 09 18:56:22.646140 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Aug 09 18:56:22.646140 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-822820483", "metadata": {"Type": "work"}}} Aug 09 18:56:22.646140 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: method: Aug 09 18:56:22.646140 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 09 18:56:22.647089 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-822820483', 'metadata': {'Type': 'work'}}}} Aug 09 18:56:22.647089 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:56:22.647089 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:22.647089 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 18:56:22.647089 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 18:56:22.647089 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 18:56:22.647089 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise error Aug 09 18:56:22.647089 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 09 18:56:22.647089 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:22.647089 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 09 18:56:22.647089 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 09 18:56:22.647089 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:22.647089 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 09 18:56:22.647089 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi '#$%' Aug 09 18:56:22.647089 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:22.647089 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:22.647089 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:22.647089 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:22.647089 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:56:22.647089 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:56:22.647089 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:56:22.647089 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:56:22.648844 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 18:56:22.648844 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 18:56:22.648844 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:56:22.648844 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:56:22.648844 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 18:56:22.648844 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 18:56:22.648844 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 18:56:22.648844 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 18:56:22.648844 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 18:56:22.648844 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 18:56:22.648844 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 09 18:56:22.648844 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:22.648844 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:22.648844 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:22.648844 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:22.648844 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:56:22.648844 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:56:22.648844 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 18:56:22.648844 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 18:56:22.650288 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 09 18:56:22.650288 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:22.650288 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-5dcb8a06-d567-45ee-af8a-15fc740e2c48 tempest-VolumesNegativeTest-507951958 tempest-VolumesNegativeTest-507951958-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:56:22.650288 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-5dcb8a06-d567-45ee-af8a-15fc740e2c48 tempest-VolumesNegativeTest-507951958 tempest-VolumesNegativeTest-507951958-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.199568 Aug 09 18:56:22.650288 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 422/876] 10.222.0.57 () {60 vars in 1156 bytes} [Tue Aug 9 18:56:22 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 201 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 18:56:22.653745 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-4e1e938e-0760-4b11-b8e9-3ab06bd71dc3 tempest-VolumesNegativeTest-507951958 tempest-VolumesNegativeTest-507951958-project] Action: 'create', calling method: .version_select at 0x7f8d6956da60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2017911888", "metadata": {"Type": "work"}}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:56:22.659834 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-4e1e938e-0760-4b11-b8e9-3ab06bd71dc3 tempest-VolumesNegativeTest-507951958 tempest-VolumesNegativeTest-507951958-project] Request method failure captured: Aug 09 18:56:22.659834 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 09 18:56:22.659834 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept: application/json Aug 09 18:56:22.659834 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Aug 09 18:56:22.659834 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Connection: close Aug 09 18:56:22.659834 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Length: 120 Aug 09 18:56:22.659834 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Type: application/json Aug 09 18:56:22.659834 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Host: 10.222.0.57 Aug 09 18:56:22.659834 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Aug 09 18:56:22.659834 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.11 Aug 09 18:56:22.659834 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABi8q3WKxoNRDc-71Pi6JRfaSmMJ1dWa9PdkK_HrsHAomSQOk4S2oh5lNzisdx7RB06sN8GWwng8luLutrxUicRxfXmi8rG2VkzXTk9-GtT2Bc64cU1-8OP3F4ZH3-rZRBGBCmzR1mbSzzLTlL8GcHIZx-rmYGXvtN7riWr04Z9OAzcCfQ Aug 09 18:56:22.659834 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Aug 09 18:56:22.659834 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Aug 09 18:56:22.659834 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Aug 09 18:56:22.659834 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Aug 09 18:56:22.659834 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Aug 09 18:56:22.659834 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Aug 09 18:56:22.659834 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Id: 5460728e12e748eeab5f345b25177f62 Aug 09 18:56:22.659834 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-VolumesNegativeTest-507951958 Aug 09 18:56:22.659834 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Role: reader,member Aug 09 18:56:22.659834 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Roles: reader,member Aug 09 18:56:22.661421 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5460728e12e748eeab5f345b25177f62", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5460728e12e748eeab5f345b25177f62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5460728e12e748eeab5f345b25177f62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5460728e12e748eeab5f345b25177f62"}]}] Aug 09 18:56:22.661421 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-VolumesNegativeTest-507951958 Aug 09 18:56:22.661421 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 5460728e12e748eeab5f345b25177f62 Aug 09 18:56:22.661421 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-VolumesNegativeTest-507951958 Aug 09 18:56:22.661421 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User: tempest-VolumesNegativeTest-507951958-project Aug 09 18:56:22.661421 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Aug 09 18:56:22.661421 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Aug 09 18:56:22.661421 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Id: 653103ee529a4f4c8e72b0bc9be5df13 Aug 09 18:56:22.661421 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-VolumesNegativeTest-507951958-project Aug 09 18:56:22.661421 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Aug 09 18:56:22.661421 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2017911888", "metadata": {"Type": "work"}}} Aug 09 18:56:22.661421 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: method: Aug 09 18:56:22.661421 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 09 18:56:22.662347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2017911888', 'metadata': {'Type': 'work'}}}} Aug 09 18:56:22.662347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:56:22.662347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:22.662347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 18:56:22.662347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 18:56:22.662347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 18:56:22.662347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise error Aug 09 18:56:22.662347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 09 18:56:22.662347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:22.662347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 09 18:56:22.662347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 09 18:56:22.662347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:22.662347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 09 18:56:22.662347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi '0' Aug 09 18:56:22.662347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:22.662347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:22.662347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:22.662347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:22.662347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:56:22.662347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:56:22.662347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:56:22.662347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:56:22.663892 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 18:56:22.663892 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 18:56:22.663892 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:56:22.663892 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:56:22.663892 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 18:56:22.663892 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 18:56:22.663892 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 18:56:22.663892 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 18:56:22.663892 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 18:56:22.663892 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 18:56:22.663892 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 09 18:56:22.663892 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:22.663892 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:22.663892 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:22.663892 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:22.663892 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:56:22.663892 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:56:22.663892 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 18:56:22.663892 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 18:56:22.665268 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 09 18:56:22.665268 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:22.665268 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-4e1e938e-0760-4b11-b8e9-3ab06bd71dc3 tempest-VolumesNegativeTest-507951958 tempest-VolumesNegativeTest-507951958-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:56:22.665268 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-4e1e938e-0760-4b11-b8e9-3ab06bd71dc3 tempest-VolumesNegativeTest-507951958 tempest-VolumesNegativeTest-507951958-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012026 Aug 09 18:56:22.674723 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-71ff19ef-b953-4d32-b7ef-02f49742fc5a tempest-VolumesNegativeTest-507951958 tempest-VolumesNegativeTest-507951958-project] Action: 'create', calling method: .version_select at 0x7f8d69bf0c10>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1063992870", "metadata": {"Type": "work"}}} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:56:22.678322 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 455/877] 10.222.0.57 () {60 vars in 1156 bytes} [Tue Aug 9 18:56:22 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 18:56:22.680551 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-71ff19ef-b953-4d32-b7ef-02f49742fc5a tempest-VolumesNegativeTest-507951958 tempest-VolumesNegativeTest-507951958-project] Request method failure captured: Aug 09 18:56:22.680551 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 09 18:56:22.680551 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept: application/json Aug 09 18:56:22.680551 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept-Encoding: identity Aug 09 18:56:22.680551 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Connection: close Aug 09 18:56:22.680551 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Length: 119 Aug 09 18:56:22.680551 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Type: application/json Aug 09 18:56:22.680551 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Host: 10.222.0.57 Aug 09 18:56:22.680551 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Openstack-System-Scope: None Aug 09 18:56:22.680551 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: User-Agent: python-urllib3/1.26.11 Aug 09 18:56:22.680551 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Auth-Token: gAAAAABi8q3WKxoNRDc-71Pi6JRfaSmMJ1dWa9PdkK_HrsHAomSQOk4S2oh5lNzisdx7RB06sN8GWwng8luLutrxUicRxfXmi8rG2VkzXTk9-GtT2Bc64cU1-8OP3F4ZH3-rZRBGBCmzR1mbSzzLTlL8GcHIZx-rmYGXvtN7riWr04Z9OAzcCfQ Aug 09 18:56:22.680551 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Id: None Aug 09 18:56:22.680551 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Name: None Aug 09 18:56:22.680551 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Identity-Status: Confirmed Aug 09 18:56:22.680551 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Is-Admin-Project: True Aug 09 18:56:22.680551 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Id: default Aug 09 18:56:22.680551 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Name: Default Aug 09 18:56:22.680551 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Id: 5460728e12e748eeab5f345b25177f62 Aug 09 18:56:22.680551 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Name: tempest-VolumesNegativeTest-507951958 Aug 09 18:56:22.680551 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Role: reader,member Aug 09 18:56:22.680551 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Roles: reader,member Aug 09 18:56:22.682116 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5460728e12e748eeab5f345b25177f62", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5460728e12e748eeab5f345b25177f62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5460728e12e748eeab5f345b25177f62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5460728e12e748eeab5f345b25177f62"}]}] Aug 09 18:56:22.682116 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant: tempest-VolumesNegativeTest-507951958 Aug 09 18:56:22.682116 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Id: 5460728e12e748eeab5f345b25177f62 Aug 09 18:56:22.682116 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Name: tempest-VolumesNegativeTest-507951958 Aug 09 18:56:22.682116 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User: tempest-VolumesNegativeTest-507951958-project Aug 09 18:56:22.682116 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Id: default Aug 09 18:56:22.682116 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Name: Default Aug 09 18:56:22.682116 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Id: 653103ee529a4f4c8e72b0bc9be5df13 Aug 09 18:56:22.682116 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Name: tempest-VolumesNegativeTest-507951958-project Aug 09 18:56:22.682116 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Aug 09 18:56:22.682116 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1063992870", "metadata": {"Type": "work"}}} Aug 09 18:56:22.682116 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: method: Aug 09 18:56:22.682116 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 09 18:56:22.683037 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1063992870', 'metadata': {'Type': 'work'}}}} Aug 09 18:56:22.683037 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:56:22.683037 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:22.683037 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 18:56:22.683037 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 18:56:22.683037 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 18:56:22.683037 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise error Aug 09 18:56:22.683037 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 09 18:56:22.683037 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:22.683037 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 09 18:56:22.683037 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 09 18:56:22.683037 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:22.683037 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 09 18:56:22.683037 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi '' Aug 09 18:56:22.683037 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:22.683037 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:22.683037 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:22.683037 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:22.683037 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:56:22.683037 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:56:22.683037 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:56:22.683037 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:56:22.684496 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 18:56:22.684496 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 18:56:22.684496 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:56:22.684496 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:56:22.684496 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 18:56:22.684496 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 18:56:22.684496 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 18:56:22.684496 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 18:56:22.684496 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 18:56:22.684496 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 18:56:22.684496 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 09 18:56:22.684496 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:22.684496 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:22.684496 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:22.684496 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:22.684496 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:56:22.684496 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:56:22.684496 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 18:56:22.684496 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 18:56:22.686202 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 09 18:56:22.686202 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:22.686202 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-71ff19ef-b953-4d32-b7ef-02f49742fc5a tempest-VolumesNegativeTest-507951958 tempest-VolumesNegativeTest-507951958-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:56:22.686202 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-71ff19ef-b953-4d32-b7ef-02f49742fc5a tempest-VolumesNegativeTest-507951958 tempest-VolumesNegativeTest-507951958-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012931 Aug 09 18:56:22.695097 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b85f56cd-c274-4391-bfb6-04dcff017886 tempest-VolumesNegativeTest-507951958 tempest-VolumesNegativeTest-507951958-project] Calling method '.version_select at 0x7f8d69432f70>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:22.696098 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 423/878] 10.222.0.57 () {60 vars in 1156 bytes} [Tue Aug 9 18:56:22 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 18:56:22.748029 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-b85f56cd-c274-4391-bfb6-04dcff017886 tempest-VolumesNegativeTest-507951958 tempest-VolumesNegativeTest-507951958-project] HTTP exception thrown: Volume tempest-invalid-500335817 could not be found. Aug 09 18:56:22.750099 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b85f56cd-c274-4391-bfb6-04dcff017886 tempest-VolumesNegativeTest-507951958 tempest-VolumesNegativeTest-507951958-project] Request method failure captured: Aug 09 18:56:22.750099 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-500335817 HTTP/1.1 Aug 09 18:56:22.750099 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept: application/json Aug 09 18:56:22.750099 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Aug 09 18:56:22.750099 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Connection: close Aug 09 18:56:22.750099 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Length: 0 Aug 09 18:56:22.750099 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Type: application/json Aug 09 18:56:22.750099 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Host: 10.222.0.57 Aug 09 18:56:22.750099 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Aug 09 18:56:22.750099 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.11 Aug 09 18:56:22.750099 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABi8q3WKxoNRDc-71Pi6JRfaSmMJ1dWa9PdkK_HrsHAomSQOk4S2oh5lNzisdx7RB06sN8GWwng8luLutrxUicRxfXmi8rG2VkzXTk9-GtT2Bc64cU1-8OP3F4ZH3-rZRBGBCmzR1mbSzzLTlL8GcHIZx-rmYGXvtN7riWr04Z9OAzcCfQ Aug 09 18:56:22.750099 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Aug 09 18:56:22.750099 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Aug 09 18:56:22.750099 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Aug 09 18:56:22.750099 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Aug 09 18:56:22.750099 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Aug 09 18:56:22.750099 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Aug 09 18:56:22.750099 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Id: 5460728e12e748eeab5f345b25177f62 Aug 09 18:56:22.750099 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-VolumesNegativeTest-507951958 Aug 09 18:56:22.750099 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Role: reader,member Aug 09 18:56:22.750099 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Roles: reader,member Aug 09 18:56:22.751781 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5460728e12e748eeab5f345b25177f62", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5460728e12e748eeab5f345b25177f62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5460728e12e748eeab5f345b25177f62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5460728e12e748eeab5f345b25177f62"}]}] Aug 09 18:56:22.751781 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-VolumesNegativeTest-507951958 Aug 09 18:56:22.751781 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 5460728e12e748eeab5f345b25177f62 Aug 09 18:56:22.751781 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-VolumesNegativeTest-507951958 Aug 09 18:56:22.751781 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User: tempest-VolumesNegativeTest-507951958-project Aug 09 18:56:22.751781 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Aug 09 18:56:22.751781 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Aug 09 18:56:22.751781 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Id: 653103ee529a4f4c8e72b0bc9be5df13 Aug 09 18:56:22.751781 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-VolumesNegativeTest-507951958-project Aug 09 18:56:22.751781 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: method: Aug 09 18:56:22.751781 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: exception: Volume tempest-invalid-500335817 could not be found. Aug 09 18:56:22.751781 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: action_args: {'id': 'tempest-invalid-500335817'} Aug 09 18:56:22.751781 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:56:22.757880 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:22.757880 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 18:56:22.757880 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 18:56:22.757880 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 18:56:22.757880 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 18:56:22.757880 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 18:56:22.757880 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 18:56:22.757880 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 18:56:22.757880 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 18:56:22.757880 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 18:56:22.757880 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 18:56:22.757880 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 18:56:22.757880 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 18:56:22.757880 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 18:56:22.757880 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 18:56:22.757880 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-500335817 could not be found. (HTTP 404) (Request-ID: req-0dcfecde-84fd-4436-8b3b-0e9978b3ba5b) Aug 09 18:56:22.757880 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:22.757880 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:22.757880 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:22.759314 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:22.759314 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 09 18:56:22.759314 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 09 18:56:22.759314 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 18:56:22.759314 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 18:56:22.759314 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 18:56:22.759314 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 18:56:22.759314 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 18:56:22.759314 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 18:56:22.759314 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 18:56:22.759314 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 18:56:22.759314 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 18:56:22.759314 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 18:56:22.759314 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 18:56:22.759314 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 18:56:22.759314 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 18:56:22.759314 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 18:56:22.759314 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 18:56:22.759314 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 18:56:22.761106 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 18:56:22.761106 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 18:56:22.761106 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 18:56:22.761106 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 18:56:22.761106 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-500335817 could not be found. Aug 09 18:56:22.761106 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:22.761106 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:22.761106 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:22.761106 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:22.761106 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:56:22.761106 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:56:22.761106 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:56:22.761106 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:56:22.761106 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 18:56:22.761106 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 18:56:22.761106 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:56:22.761106 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:56:22.761106 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 09 18:56:22.761106 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:56:22.761106 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-500335817 could not be found. Aug 09 18:56:22.762601 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:22.762601 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:22.762601 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:22.762601 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:22.762601 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:56:22.762601 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:56:22.762601 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:56:22.762601 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:56:22.762601 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-500335817 could not be found. Aug 09 18:56:22.762601 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:22.762601 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b85f56cd-c274-4391-bfb6-04dcff017886 tempest-VolumesNegativeTest-507951958 tempest-VolumesNegativeTest-507951958-project] Returning 404 to user: Volume tempest-invalid-500335817 could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:56:22.762601 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-b85f56cd-c274-4391-bfb6-04dcff017886 tempest-VolumesNegativeTest-507951958 tempest-VolumesNegativeTest-507951958-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/tempest-invalid-500335817" status: 404 len: 98 microversion: 2.1 time: 0.061240 Aug 09 18:56:22.762601 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 456/879] 10.222.0.57 () {58 vars in 1215 bytes} [Tue Aug 9 18:56:22 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-500335817 => generated 98 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 18:56:22.771027 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-a4d2c705-edc6-4902-9f9e-af023ad0e6d1 tempest-VolumesNegativeTest-507951958 tempest-VolumesNegativeTest-507951958-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004846 Aug 09 18:56:22.775267 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 424/880] 10.222.0.57 () {58 vars in 1140 bytes} [Tue Aug 9 18:56:22 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 09 18:56:22.782950 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-567419c5-4bad-4f6e-97c9-043d71361264 tempest-VolumesNegativeTest-507951958 tempest-VolumesNegativeTest-507951958-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003993 Aug 09 18:56:22.783454 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 457/881] 10.222.0.57 () {58 vars in 1137 bytes} [Tue Aug 9 18:56:22 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 09 18:56:22.792886 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-e87d3b6f-cc34-4976-a763-86160b1dbf02 tempest-VolumesNegativeTest-507951958 tempest-VolumesNegativeTest-507951958-project] Calling method '.version_select at 0x7f8d69dde160>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:22.830314 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.wsgi [None req-e87d3b6f-cc34-4976-a763-86160b1dbf02 tempest-VolumesNegativeTest-507951958 tempest-VolumesNegativeTest-507951958-project] HTTP exception thrown: Volume 2aacee3f-4308-4508-9878-a795481ea5c3 could not be found. Aug 09 18:56:22.832763 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-e87d3b6f-cc34-4976-a763-86160b1dbf02 tempest-VolumesNegativeTest-507951958 tempest-VolumesNegativeTest-507951958-project] Request method failure captured: Aug 09 18:56:22.832763 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: request: DELETE /compute/v2.1/os-volumes/2aacee3f-4308-4508-9878-a795481ea5c3 HTTP/1.1 Aug 09 18:56:22.832763 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept: application/json Aug 09 18:56:22.832763 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept-Encoding: identity Aug 09 18:56:22.832763 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Connection: close Aug 09 18:56:22.832763 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Length: 0 Aug 09 18:56:22.832763 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Type: application/json Aug 09 18:56:22.832763 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Host: 10.222.0.57 Aug 09 18:56:22.832763 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Openstack-System-Scope: None Aug 09 18:56:22.832763 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: User-Agent: python-urllib3/1.26.11 Aug 09 18:56:22.832763 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Auth-Token: gAAAAABi8q3WKxoNRDc-71Pi6JRfaSmMJ1dWa9PdkK_HrsHAomSQOk4S2oh5lNzisdx7RB06sN8GWwng8luLutrxUicRxfXmi8rG2VkzXTk9-GtT2Bc64cU1-8OP3F4ZH3-rZRBGBCmzR1mbSzzLTlL8GcHIZx-rmYGXvtN7riWr04Z9OAzcCfQ Aug 09 18:56:22.832763 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Id: None Aug 09 18:56:22.832763 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Name: None Aug 09 18:56:22.832763 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Identity-Status: Confirmed Aug 09 18:56:22.832763 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Is-Admin-Project: True Aug 09 18:56:22.832763 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Id: default Aug 09 18:56:22.832763 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Name: Default Aug 09 18:56:22.832763 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Id: 5460728e12e748eeab5f345b25177f62 Aug 09 18:56:22.832763 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Name: tempest-VolumesNegativeTest-507951958 Aug 09 18:56:22.832763 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Role: reader,member Aug 09 18:56:22.832763 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Roles: reader,member Aug 09 18:56:22.834452 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5460728e12e748eeab5f345b25177f62", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5460728e12e748eeab5f345b25177f62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5460728e12e748eeab5f345b25177f62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5460728e12e748eeab5f345b25177f62"}]}] Aug 09 18:56:22.834452 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant: tempest-VolumesNegativeTest-507951958 Aug 09 18:56:22.834452 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Id: 5460728e12e748eeab5f345b25177f62 Aug 09 18:56:22.834452 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Name: tempest-VolumesNegativeTest-507951958 Aug 09 18:56:22.834452 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User: tempest-VolumesNegativeTest-507951958-project Aug 09 18:56:22.834452 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Id: default Aug 09 18:56:22.834452 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Name: Default Aug 09 18:56:22.834452 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Id: 653103ee529a4f4c8e72b0bc9be5df13 Aug 09 18:56:22.834452 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Name: tempest-VolumesNegativeTest-507951958-project Aug 09 18:56:22.834452 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: method: Aug 09 18:56:22.834452 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: exception: Volume 2aacee3f-4308-4508-9878-a795481ea5c3 could not be found. Aug 09 18:56:22.834452 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: action_args: {'id': '2aacee3f-4308-4508-9878-a795481ea5c3'} Aug 09 18:56:22.834452 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:56:22.835432 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:22.835432 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 18:56:22.835432 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 18:56:22.835432 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 18:56:22.835432 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 18:56:22.835432 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 18:56:22.835432 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 18:56:22.835432 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 18:56:22.835432 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 18:56:22.835432 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 18:56:22.835432 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 18:56:22.835432 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 18:56:22.835432 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 18:56:22.835432 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 18:56:22.835432 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 18:56:22.835432 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2aacee3f-4308-4508-9878-a795481ea5c3 could not be found. (HTTP 404) (Request-ID: req-0ed89499-1f5f-49fa-9c6d-aced28301b33) Aug 09 18:56:22.835432 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:22.835432 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:22.835432 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:22.836834 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:22.836834 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 09 18:56:22.836834 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 09 18:56:22.836834 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 18:56:22.836834 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 18:56:22.836834 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 18:56:22.836834 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 18:56:22.836834 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 18:56:22.836834 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 18:56:22.836834 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 18:56:22.836834 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 18:56:22.836834 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 18:56:22.836834 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 18:56:22.836834 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 18:56:22.836834 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 18:56:22.836834 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 18:56:22.836834 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 18:56:22.836834 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 18:56:22.836834 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 18:56:22.844636 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 18:56:22.844636 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 18:56:22.844636 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 18:56:22.844636 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 18:56:22.844636 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2aacee3f-4308-4508-9878-a795481ea5c3 could not be found. Aug 09 18:56:22.844636 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:22.844636 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:22.844636 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:22.844636 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:22.844636 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:56:22.844636 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:56:22.844636 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:56:22.844636 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:56:22.844636 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 18:56:22.844636 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 18:56:22.844636 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:56:22.844636 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:56:22.844636 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 09 18:56:22.844636 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:56:22.846072 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2aacee3f-4308-4508-9878-a795481ea5c3 could not be found. Aug 09 18:56:22.846072 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:22.846072 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:22.846072 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:22.846072 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:22.846072 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:56:22.846072 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:56:22.846072 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:56:22.846072 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:56:22.846072 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2aacee3f-4308-4508-9878-a795481ea5c3 could not be found. Aug 09 18:56:22.846072 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:22.846072 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-e87d3b6f-cc34-4976-a763-86160b1dbf02 tempest-VolumesNegativeTest-507951958 tempest-VolumesNegativeTest-507951958-project] Returning 404 to user: Volume 2aacee3f-4308-4508-9878-a795481ea5c3 could not be found. {{(pid=124726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:56:22.846072 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-e87d3b6f-cc34-4976-a763-86160b1dbf02 tempest-VolumesNegativeTest-507951958 tempest-VolumesNegativeTest-507951958-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/2aacee3f-4308-4508-9878-a795481ea5c3" status: 404 len: 109 microversion: 2.1 time: 0.046169 Aug 09 18:56:22.846072 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 425/882] 10.222.0.57 () {58 vars in 1248 bytes} [Tue Aug 9 18:56:22 2022] DELETE /compute/v2.1/os-volumes/2aacee3f-4308-4508-9878-a795481ea5c3 => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:56:22.847644 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d9a35c31-4a75-44f5-9901-6acbb425c4b0 tempest-VolumesNegativeTest-507951958 tempest-VolumesNegativeTest-507951958-project] Calling method '.version_select at 0x7f8d694b3af0>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:22.883483 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-d9a35c31-4a75-44f5-9901-6acbb425c4b0 tempest-VolumesNegativeTest-507951958 tempest-VolumesNegativeTest-507951958-project] HTTP exception thrown: Volume a439b10d-0bd1-4033-9495-39ddaa1e6fe3 could not be found. Aug 09 18:56:22.885542 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d9a35c31-4a75-44f5-9901-6acbb425c4b0 tempest-VolumesNegativeTest-507951958 tempest-VolumesNegativeTest-507951958-project] Request method failure captured: Aug 09 18:56:22.885542 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: request: GET /compute/v2.1/os-volumes/a439b10d-0bd1-4033-9495-39ddaa1e6fe3 HTTP/1.1 Aug 09 18:56:22.885542 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept: application/json Aug 09 18:56:22.885542 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Aug 09 18:56:22.885542 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Connection: close Aug 09 18:56:22.885542 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Length: 0 Aug 09 18:56:22.885542 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Type: application/json Aug 09 18:56:22.885542 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Host: 10.222.0.57 Aug 09 18:56:22.885542 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Aug 09 18:56:22.885542 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.11 Aug 09 18:56:22.885542 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABi8q3WKxoNRDc-71Pi6JRfaSmMJ1dWa9PdkK_HrsHAomSQOk4S2oh5lNzisdx7RB06sN8GWwng8luLutrxUicRxfXmi8rG2VkzXTk9-GtT2Bc64cU1-8OP3F4ZH3-rZRBGBCmzR1mbSzzLTlL8GcHIZx-rmYGXvtN7riWr04Z9OAzcCfQ Aug 09 18:56:22.885542 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Aug 09 18:56:22.885542 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Aug 09 18:56:22.885542 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Aug 09 18:56:22.885542 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Aug 09 18:56:22.885542 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Aug 09 18:56:22.885542 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Aug 09 18:56:22.885542 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Id: 5460728e12e748eeab5f345b25177f62 Aug 09 18:56:22.885542 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-VolumesNegativeTest-507951958 Aug 09 18:56:22.885542 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Role: reader,member Aug 09 18:56:22.885542 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Roles: reader,member Aug 09 18:56:22.887924 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5460728e12e748eeab5f345b25177f62", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5460728e12e748eeab5f345b25177f62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5460728e12e748eeab5f345b25177f62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5460728e12e748eeab5f345b25177f62"}]}] Aug 09 18:56:22.887924 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-VolumesNegativeTest-507951958 Aug 09 18:56:22.887924 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 5460728e12e748eeab5f345b25177f62 Aug 09 18:56:22.887924 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-VolumesNegativeTest-507951958 Aug 09 18:56:22.887924 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User: tempest-VolumesNegativeTest-507951958-project Aug 09 18:56:22.887924 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Aug 09 18:56:22.887924 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Aug 09 18:56:22.887924 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Id: 653103ee529a4f4c8e72b0bc9be5df13 Aug 09 18:56:22.887924 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-VolumesNegativeTest-507951958-project Aug 09 18:56:22.887924 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: method: Aug 09 18:56:22.887924 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: exception: Volume a439b10d-0bd1-4033-9495-39ddaa1e6fe3 could not be found. Aug 09 18:56:22.887924 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: action_args: {'id': 'a439b10d-0bd1-4033-9495-39ddaa1e6fe3'} Aug 09 18:56:22.887924 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:56:22.889615 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:22.889615 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 18:56:22.889615 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 18:56:22.889615 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 18:56:22.889615 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 18:56:22.889615 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 18:56:22.889615 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 18:56:22.889615 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 18:56:22.889615 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 18:56:22.889615 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 18:56:22.889615 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 18:56:22.889615 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 18:56:22.889615 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 18:56:22.889615 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 18:56:22.889615 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 18:56:22.889615 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a439b10d-0bd1-4033-9495-39ddaa1e6fe3 could not be found. (HTTP 404) (Request-ID: req-0490a469-e7cb-432b-910e-bb78ae4c08e9) Aug 09 18:56:22.889615 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:22.889615 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:22.889615 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:22.891064 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:22.891064 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 18:56:22.891064 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 18:56:22.891064 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 18:56:22.891064 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 18:56:22.891064 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 18:56:22.891064 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 18:56:22.891064 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 18:56:22.891064 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 18:56:22.891064 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 18:56:22.891064 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 18:56:22.891064 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 18:56:22.891064 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 18:56:22.891064 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 18:56:22.891064 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 18:56:22.891064 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 18:56:22.891064 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 18:56:22.891064 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 18:56:22.891064 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 18:56:22.892459 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 18:56:22.892459 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 18:56:22.892459 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 18:56:22.892459 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 18:56:22.892459 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a439b10d-0bd1-4033-9495-39ddaa1e6fe3 could not be found. Aug 09 18:56:22.892459 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:22.892459 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:22.892459 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:22.892459 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:22.892459 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:56:22.892459 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:56:22.892459 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:56:22.892459 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:56:22.892459 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 18:56:22.892459 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 18:56:22.892459 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:56:22.892459 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:56:22.892459 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 18:56:22.892459 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:56:22.894686 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a439b10d-0bd1-4033-9495-39ddaa1e6fe3 could not be found. Aug 09 18:56:22.894686 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:22.894686 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:22.894686 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:22.894686 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:22.894686 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:56:22.894686 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:56:22.894686 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:56:22.894686 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:56:22.894686 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a439b10d-0bd1-4033-9495-39ddaa1e6fe3 could not be found. Aug 09 18:56:22.894686 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:22.894686 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d9a35c31-4a75-44f5-9901-6acbb425c4b0 tempest-VolumesNegativeTest-507951958 tempest-VolumesNegativeTest-507951958-project] Returning 404 to user: Volume a439b10d-0bd1-4033-9495-39ddaa1e6fe3 could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:56:22.894686 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-d9a35c31-4a75-44f5-9901-6acbb425c4b0 tempest-VolumesNegativeTest-507951958 tempest-VolumesNegativeTest-507951958-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/a439b10d-0bd1-4033-9495-39ddaa1e6fe3" status: 404 len: 109 microversion: 2.1 time: 0.047069 Aug 09 18:56:22.896183 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 458/883] 10.222.0.57 () {58 vars in 1245 bytes} [Tue Aug 9 18:56:22 2022] GET /compute/v2.1/os-volumes/a439b10d-0bd1-4033-9495-39ddaa1e6fe3 => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:56:23.085649 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-5e74dad7-4031-465a-8121-01f4540387e5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:23.086495 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-5e74dad7-4031-465a-8121-01f4540387e5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:23.094039 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5e74dad7-4031-465a-8121-01f4540387e5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:23.094535 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5e74dad7-4031-465a-8121-01f4540387e5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:23.095005 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5e74dad7-4031-465a-8121-01f4540387e5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:23.095713 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5e74dad7-4031-465a-8121-01f4540387e5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:23.096537 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5e74dad7-4031-465a-8121-01f4540387e5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:23.097704 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5e74dad7-4031-465a-8121-01f4540387e5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:23.121150 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:56:23.257879 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-5e74dad7-4031-465a-8121-01f4540387e5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:23.267525 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-5e74dad7-4031-465a-8121-01f4540387e5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1359 microversion: 2.1 time: 0.186703 Aug 09 18:56:23.272776 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 426/884] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:23 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1359 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:56:23.301301 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=2 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:56:23.302097 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=10 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:56:23.308453 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-ff729be5-d566-4c70-834a-aea8b0552802 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:23.309061 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-ff729be5-d566-4c70-834a-aea8b0552802 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:23.315465 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ff729be5-d566-4c70-834a-aea8b0552802 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:23.315958 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ff729be5-d566-4c70-834a-aea8b0552802 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:23.316391 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ff729be5-d566-4c70-834a-aea8b0552802 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:23.317086 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ff729be5-d566-4c70-834a-aea8b0552802 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:23.317561 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ff729be5-d566-4c70-834a-aea8b0552802 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:23.317979 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ff729be5-d566-4c70-834a-aea8b0552802 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:23.453961 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-31db7d66-e40b-43e7-8c9d-7fb5e4437a84 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:23.454602 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-31db7d66-e40b-43e7-8c9d-7fb5e4437a84 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: f349cf3d-5117-4617-ad83-8c0cc44f5bd5] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:23.463304 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell0:SELECT=10 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:56:23.464845 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-31db7d66-e40b-43e7-8c9d-7fb5e4437a84 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:23.465339 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-31db7d66-e40b-43e7-8c9d-7fb5e4437a84 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:23.467281 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-31db7d66-e40b-43e7-8c9d-7fb5e4437a84 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:23.468198 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-31db7d66-e40b-43e7-8c9d-7fb5e4437a84 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:23.470141 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-31db7d66-e40b-43e7-8c9d-7fb5e4437a84 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:23.477049 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-ff729be5-d566-4c70-834a-aea8b0552802 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:23.477837 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-31db7d66-e40b-43e7-8c9d-7fb5e4437a84 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:23.486045 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-ff729be5-d566-4c70-834a-aea8b0552802 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37" status: 200 len: 1318 microversion: 2.1 time: 0.185458 Aug 09 18:56:23.487373 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 459/885] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:23 2022] GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:56:23.499562 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.wsgi [None req-31db7d66-e40b-43e7-8c9d-7fb5e4437a84 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] HTTP exception thrown: Instance f349cf3d-5117-4617-ad83-8c0cc44f5bd5 could not be found. Aug 09 18:56:23.501379 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-31db7d66-e40b-43e7-8c9d-7fb5e4437a84 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Request method failure captured: Aug 09 18:56:23.501379 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: request: GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5 HTTP/1.1 Aug 09 18:56:23.501379 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept: application/json Aug 09 18:56:23.501379 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept-Encoding: identity Aug 09 18:56:23.501379 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Connection: close Aug 09 18:56:23.501379 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Length: 0 Aug 09 18:56:23.501379 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Type: application/json Aug 09 18:56:23.501379 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Host: 10.222.0.57 Aug 09 18:56:23.501379 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Openstack-System-Scope: None Aug 09 18:56:23.501379 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: User-Agent: python-urllib3/1.26.11 Aug 09 18:56:23.501379 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Auth-Token: gAAAAABi8qxu6GlCXsghs7mXHsJ6lMdriR0lCN6zx0jJtIVa-hoSSpRyn9kABjaS5Ya_Ocw2sU0SEZSB-MC5jyn7nC01Qf-R3Wxc4u_OmCKdxSmXeuRuDoxnEqYVjV6mxSKvywrengnzW8AvtzIMJfiluX7W9B1UousoG9Ld7Q7tERFPOMWrYmI Aug 09 18:56:23.501379 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Id: None Aug 09 18:56:23.501379 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Name: None Aug 09 18:56:23.501379 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Identity-Status: Confirmed Aug 09 18:56:23.501379 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Is-Admin-Project: True Aug 09 18:56:23.501379 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Id: default Aug 09 18:56:23.501379 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Name: Default Aug 09 18:56:23.501379 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Id: 4a745db383cb452187f7c82b9977c09b Aug 09 18:56:23.501379 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Name: tempest-AttachVolumeNegativeTest-1856281892 Aug 09 18:56:23.501379 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Role: reader,member Aug 09 18:56:23.501379 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Roles: reader,member Aug 09 18:56:23.503610 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4a745db383cb452187f7c82b9977c09b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a745db383cb452187f7c82b9977c09b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4a745db383cb452187f7c82b9977c09b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a745db383cb452187f7c82b9977c09b"}]}] Aug 09 18:56:23.503610 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant: tempest-AttachVolumeNegativeTest-1856281892 Aug 09 18:56:23.503610 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Id: 4a745db383cb452187f7c82b9977c09b Aug 09 18:56:23.503610 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1856281892 Aug 09 18:56:23.503610 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User: tempest-AttachVolumeNegativeTest-1856281892-project Aug 09 18:56:23.503610 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Id: default Aug 09 18:56:23.503610 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Name: Default Aug 09 18:56:23.503610 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Id: 00491255f4b44125b6dc9f816c9bbb58 Aug 09 18:56:23.503610 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Name: tempest-AttachVolumeNegativeTest-1856281892-project Aug 09 18:56:23.503610 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: method: > Aug 09 18:56:23.503610 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: exception: Instance f349cf3d-5117-4617-ad83-8c0cc44f5bd5 could not be found. Aug 09 18:56:23.503610 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: action_args: {'id': 'f349cf3d-5117-4617-ad83-8c0cc44f5bd5'} Aug 09 18:56:23.504605 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:56:23.504605 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:23.504605 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:56:23.504605 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:56:23.504605 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:56:23.504605 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:56:23.504605 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:56:23.504605 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:56:23.504605 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:56:23.504605 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:56:23.504605 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f349cf3d-5117-4617-ad83-8c0cc44f5bd5 could not be found. Aug 09 18:56:23.504605 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:23.504605 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:23.504605 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:23.504605 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:23.504605 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:56:23.504605 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:56:23.504605 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:56:23.504605 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:56:23.504605 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:56:23.506291 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:56:23.506291 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:56:23.506291 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:56:23.506291 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:56:23.506291 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:56:23.506291 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:56:23.506291 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:56:23.506291 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f349cf3d-5117-4617-ad83-8c0cc44f5bd5 could not be found. Aug 09 18:56:23.506291 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:23.506291 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:23.506291 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:23.506291 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:23.506291 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:56:23.506291 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:56:23.506291 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:56:23.506291 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:56:23.506291 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f349cf3d-5117-4617-ad83-8c0cc44f5bd5 could not be found. Aug 09 18:56:23.506291 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:23.523062 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-31db7d66-e40b-43e7-8c9d-7fb5e4437a84 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Returning 404 to user: Instance f349cf3d-5117-4617-ad83-8c0cc44f5bd5 could not be found. {{(pid=124726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:56:23.523062 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-31db7d66-e40b-43e7-8c9d-7fb5e4437a84 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5" status: 404 len: 111 microversion: 2.1 time: 0.072872 Aug 09 18:56:23.524222 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 427/886] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:23 2022] GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:56:23.533880 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-bbdd979a-58be-4cca-9c54-d70ac1be2a6f tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '.version_select at 0x7f8d69452c10>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:23.620741 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-bbdd979a-58be-4cca-9c54-d70ac1be2a6f tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-559630473" status: 202 len: 0 microversion: 2.1 time: 0.092201 Aug 09 18:56:23.621900 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 460/887] 10.222.0.57 () {58 vars in 1218 bytes} [Tue Aug 9 18:56:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-559630473 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:56:24.295383 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-0058d895-04cf-4367-8843-be14c7852973 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:24.296003 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-0058d895-04cf-4367-8843-be14c7852973 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:24.306321 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0058d895-04cf-4367-8843-be14c7852973 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:24.306912 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0058d895-04cf-4367-8843-be14c7852973 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:24.307404 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0058d895-04cf-4367-8843-be14c7852973 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:24.308685 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0058d895-04cf-4367-8843-be14c7852973 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:24.314301 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0058d895-04cf-4367-8843-be14c7852973 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:24.314962 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0058d895-04cf-4367-8843-be14c7852973 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:24.514068 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f2c05536-e853-42e2-8a54-c9c56bb0735b tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:24.515884 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-f2c05536-e853-42e2-8a54-c9c56bb0735b tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:24.524473 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f2c05536-e853-42e2-8a54-c9c56bb0735b tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:24.524978 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f2c05536-e853-42e2-8a54-c9c56bb0735b tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:24.531855 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f2c05536-e853-42e2-8a54-c9c56bb0735b tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:24.533937 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f2c05536-e853-42e2-8a54-c9c56bb0735b tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:24.536314 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f2c05536-e853-42e2-8a54-c9c56bb0735b tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:24.537035 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f2c05536-e853-42e2-8a54-c9c56bb0735b tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:24.602050 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-0058d895-04cf-4367-8843-be14c7852973 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:24.611869 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-0058d895-04cf-4367-8843-be14c7852973 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1359 microversion: 2.1 time: 0.320536 Aug 09 18:56:24.615538 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 428/888] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:24 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1359 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:56:24.798070 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f2c05536-e853-42e2-8a54-c9c56bb0735b tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:24.809706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f2c05536-e853-42e2-8a54-c9c56bb0735b tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37" status: 200 len: 1318 microversion: 2.1 time: 0.302866 Aug 09 18:56:24.823289 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 461/889] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:24 2022] GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37 => generated 1318 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:56:25.634840 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-56b9ce6a-0790-43af-874a-01a206ef3ad9 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:25.636261 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-56b9ce6a-0790-43af-874a-01a206ef3ad9 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:25.643814 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-56b9ce6a-0790-43af-874a-01a206ef3ad9 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:25.644314 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-56b9ce6a-0790-43af-874a-01a206ef3ad9 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:25.644751 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-56b9ce6a-0790-43af-874a-01a206ef3ad9 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:25.645464 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-56b9ce6a-0790-43af-874a-01a206ef3ad9 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:25.645963 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-56b9ce6a-0790-43af-874a-01a206ef3ad9 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:25.646390 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-56b9ce6a-0790-43af-874a-01a206ef3ad9 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:25.832671 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-56b9ce6a-0790-43af-874a-01a206ef3ad9 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:25.833651 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-39cbb356-031f-4149-b4c9-c5b309e8129d tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:25.834843 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-39cbb356-031f-4149-b4c9-c5b309e8129d tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:25.841331 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-56b9ce6a-0790-43af-874a-01a206ef3ad9 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1359 microversion: 2.1 time: 0.210259 Aug 09 18:56:25.851327 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 429/890] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:25 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1359 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:56:25.857498 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-39cbb356-031f-4149-b4c9-c5b309e8129d tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:25.859061 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-39cbb356-031f-4149-b4c9-c5b309e8129d tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:25.859538 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-39cbb356-031f-4149-b4c9-c5b309e8129d tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:25.860252 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-39cbb356-031f-4149-b4c9-c5b309e8129d tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:25.860851 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-39cbb356-031f-4149-b4c9-c5b309e8129d tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:25.861282 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-39cbb356-031f-4149-b4c9-c5b309e8129d tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:25.866530 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:56:26.018329 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-39cbb356-031f-4149-b4c9-c5b309e8129d tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:26.027331 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-39cbb356-031f-4149-b4c9-c5b309e8129d tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37" status: 200 len: 1318 microversion: 2.1 time: 0.200148 Aug 09 18:56:26.038244 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 462/891] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:25 2022] GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:56:26.195663 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-9e34db95-c8a4-428c-b6e5-2ac02b786491 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:26.196575 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-9e34db95-c8a4-428c-b6e5-2ac02b786491 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: f349cf3d-5117-4617-ad83-8c0cc44f5bd5] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:26.204175 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9e34db95-c8a4-428c-b6e5-2ac02b786491 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:26.205164 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9e34db95-c8a4-428c-b6e5-2ac02b786491 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:26.205951 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9e34db95-c8a4-428c-b6e5-2ac02b786491 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:26.207416 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9e34db95-c8a4-428c-b6e5-2ac02b786491 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:26.208155 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9e34db95-c8a4-428c-b6e5-2ac02b786491 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:26.208648 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9e34db95-c8a4-428c-b6e5-2ac02b786491 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:26.225177 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.wsgi [None req-9e34db95-c8a4-428c-b6e5-2ac02b786491 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] HTTP exception thrown: Instance f349cf3d-5117-4617-ad83-8c0cc44f5bd5 could not be found. Aug 09 18:56:26.227050 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-9e34db95-c8a4-428c-b6e5-2ac02b786491 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Request method failure captured: Aug 09 18:56:26.227050 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: request: DELETE /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5 HTTP/1.1 Aug 09 18:56:26.227050 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept: application/json Aug 09 18:56:26.227050 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept-Encoding: identity Aug 09 18:56:26.227050 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Connection: close Aug 09 18:56:26.227050 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Length: 0 Aug 09 18:56:26.227050 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Type: application/json Aug 09 18:56:26.227050 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Host: 10.222.0.57 Aug 09 18:56:26.227050 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Openstack-System-Scope: None Aug 09 18:56:26.227050 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: User-Agent: python-urllib3/1.26.11 Aug 09 18:56:26.227050 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Auth-Token: gAAAAABi8qxu6GlCXsghs7mXHsJ6lMdriR0lCN6zx0jJtIVa-hoSSpRyn9kABjaS5Ya_Ocw2sU0SEZSB-MC5jyn7nC01Qf-R3Wxc4u_OmCKdxSmXeuRuDoxnEqYVjV6mxSKvywrengnzW8AvtzIMJfiluX7W9B1UousoG9Ld7Q7tERFPOMWrYmI Aug 09 18:56:26.227050 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Id: None Aug 09 18:56:26.227050 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Name: None Aug 09 18:56:26.227050 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Identity-Status: Confirmed Aug 09 18:56:26.227050 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Is-Admin-Project: True Aug 09 18:56:26.227050 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Id: default Aug 09 18:56:26.227050 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Name: Default Aug 09 18:56:26.227050 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Id: 4a745db383cb452187f7c82b9977c09b Aug 09 18:56:26.227050 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Name: tempest-AttachVolumeNegativeTest-1856281892 Aug 09 18:56:26.227050 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Role: reader,member Aug 09 18:56:26.227050 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Roles: reader,member Aug 09 18:56:26.228759 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4a745db383cb452187f7c82b9977c09b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a745db383cb452187f7c82b9977c09b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4a745db383cb452187f7c82b9977c09b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a745db383cb452187f7c82b9977c09b"}]}] Aug 09 18:56:26.228759 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant: tempest-AttachVolumeNegativeTest-1856281892 Aug 09 18:56:26.228759 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Id: 4a745db383cb452187f7c82b9977c09b Aug 09 18:56:26.228759 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1856281892 Aug 09 18:56:26.228759 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User: tempest-AttachVolumeNegativeTest-1856281892-project Aug 09 18:56:26.228759 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Id: default Aug 09 18:56:26.228759 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Name: Default Aug 09 18:56:26.228759 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Id: 00491255f4b44125b6dc9f816c9bbb58 Aug 09 18:56:26.228759 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Name: tempest-AttachVolumeNegativeTest-1856281892-project Aug 09 18:56:26.228759 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: method: > Aug 09 18:56:26.228759 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: exception: Instance f349cf3d-5117-4617-ad83-8c0cc44f5bd5 could not be found. Aug 09 18:56:26.228759 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: action_args: {'id': 'f349cf3d-5117-4617-ad83-8c0cc44f5bd5'} Aug 09 18:56:26.229687 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:56:26.229687 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:26.229687 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:56:26.229687 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:56:26.229687 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:56:26.229687 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:56:26.229687 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:56:26.229687 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:56:26.229687 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:56:26.229687 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:56:26.229687 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f349cf3d-5117-4617-ad83-8c0cc44f5bd5 could not be found. Aug 09 18:56:26.229687 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:26.229687 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:26.229687 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:26.229687 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:26.229687 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:56:26.229687 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:56:26.229687 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:56:26.229687 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:56:26.229687 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:56:26.231339 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:56:26.231339 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 18:56:26.231339 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 18:56:26.231339 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 18:56:26.231339 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 18:56:26.231339 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:56:26.231339 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:56:26.231339 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:56:26.231339 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:56:26.231339 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f349cf3d-5117-4617-ad83-8c0cc44f5bd5 could not be found. Aug 09 18:56:26.231339 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:26.231339 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:26.231339 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:26.231339 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:26.231339 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:56:26.231339 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:56:26.231339 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:56:26.231339 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:56:26.231339 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f349cf3d-5117-4617-ad83-8c0cc44f5bd5 could not be found. Aug 09 18:56:26.231339 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:26.233714 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-9e34db95-c8a4-428c-b6e5-2ac02b786491 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Returning 404 to user: Instance f349cf3d-5117-4617-ad83-8c0cc44f5bd5 could not be found. {{(pid=124726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:56:26.234776 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-9e34db95-c8a4-428c-b6e5-2ac02b786491 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5" status: 404 len: 111 microversion: 2.1 time: 0.052737 Aug 09 18:56:26.235534 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 430/892] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 9 18:56:26 2022] DELETE /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:56:26.243623 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-cf58dee8-9b23-43be-86f9-a6d23e072e58 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:26.244227 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-cf58dee8-9b23-43be-86f9-a6d23e072e58 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: f349cf3d-5117-4617-ad83-8c0cc44f5bd5] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:26.250974 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cf58dee8-9b23-43be-86f9-a6d23e072e58 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:26.251456 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cf58dee8-9b23-43be-86f9-a6d23e072e58 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:26.252022 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cf58dee8-9b23-43be-86f9-a6d23e072e58 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:26.253175 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cf58dee8-9b23-43be-86f9-a6d23e072e58 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:26.253924 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cf58dee8-9b23-43be-86f9-a6d23e072e58 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:26.254434 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cf58dee8-9b23-43be-86f9-a6d23e072e58 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:26.272905 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-cf58dee8-9b23-43be-86f9-a6d23e072e58 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] HTTP exception thrown: Instance f349cf3d-5117-4617-ad83-8c0cc44f5bd5 could not be found. Aug 09 18:56:26.275361 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-cf58dee8-9b23-43be-86f9-a6d23e072e58 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Request method failure captured: Aug 09 18:56:26.275361 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: request: GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5 HTTP/1.1 Aug 09 18:56:26.275361 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept: application/json Aug 09 18:56:26.275361 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Aug 09 18:56:26.275361 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Connection: close Aug 09 18:56:26.275361 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Length: 0 Aug 09 18:56:26.275361 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Type: application/json Aug 09 18:56:26.275361 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Host: 10.222.0.57 Aug 09 18:56:26.275361 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Aug 09 18:56:26.275361 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.11 Aug 09 18:56:26.275361 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABi8qxu6GlCXsghs7mXHsJ6lMdriR0lCN6zx0jJtIVa-hoSSpRyn9kABjaS5Ya_Ocw2sU0SEZSB-MC5jyn7nC01Qf-R3Wxc4u_OmCKdxSmXeuRuDoxnEqYVjV6mxSKvywrengnzW8AvtzIMJfiluX7W9B1UousoG9Ld7Q7tERFPOMWrYmI Aug 09 18:56:26.275361 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Aug 09 18:56:26.275361 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Aug 09 18:56:26.275361 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Aug 09 18:56:26.275361 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Aug 09 18:56:26.275361 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Aug 09 18:56:26.275361 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Aug 09 18:56:26.275361 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Id: 4a745db383cb452187f7c82b9977c09b Aug 09 18:56:26.275361 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-AttachVolumeNegativeTest-1856281892 Aug 09 18:56:26.275361 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Role: reader,member Aug 09 18:56:26.275361 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Roles: reader,member Aug 09 18:56:26.277036 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4a745db383cb452187f7c82b9977c09b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a745db383cb452187f7c82b9977c09b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4a745db383cb452187f7c82b9977c09b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a745db383cb452187f7c82b9977c09b"}]}] Aug 09 18:56:26.277036 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-AttachVolumeNegativeTest-1856281892 Aug 09 18:56:26.277036 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 4a745db383cb452187f7c82b9977c09b Aug 09 18:56:26.277036 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1856281892 Aug 09 18:56:26.277036 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User: tempest-AttachVolumeNegativeTest-1856281892-project Aug 09 18:56:26.277036 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Aug 09 18:56:26.277036 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Aug 09 18:56:26.277036 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Id: 00491255f4b44125b6dc9f816c9bbb58 Aug 09 18:56:26.277036 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-AttachVolumeNegativeTest-1856281892-project Aug 09 18:56:26.277036 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: method: > Aug 09 18:56:26.277036 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: exception: Instance f349cf3d-5117-4617-ad83-8c0cc44f5bd5 could not be found. Aug 09 18:56:26.277036 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: action_args: {'id': 'f349cf3d-5117-4617-ad83-8c0cc44f5bd5'} Aug 09 18:56:26.277958 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:56:26.277958 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:26.277958 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:56:26.277958 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:56:26.277958 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:56:26.277958 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:56:26.277958 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:56:26.277958 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:56:26.277958 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:56:26.277958 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:56:26.277958 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f349cf3d-5117-4617-ad83-8c0cc44f5bd5 could not be found. Aug 09 18:56:26.277958 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:26.277958 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:26.277958 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:26.277958 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:26.277958 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:56:26.277958 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:56:26.277958 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:56:26.277958 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:56:26.277958 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:56:26.279215 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:56:26.279215 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:56:26.279215 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:56:26.279215 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:56:26.279215 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:56:26.279215 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:56:26.279215 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:56:26.279215 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f349cf3d-5117-4617-ad83-8c0cc44f5bd5 could not be found. Aug 09 18:56:26.279215 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:26.279215 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:26.279215 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:26.279215 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:26.279215 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:56:26.279215 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:56:26.279215 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:56:26.279215 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:56:26.279215 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f349cf3d-5117-4617-ad83-8c0cc44f5bd5 could not be found. Aug 09 18:56:26.279215 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:26.281559 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-cf58dee8-9b23-43be-86f9-a6d23e072e58 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Returning 404 to user: Instance f349cf3d-5117-4617-ad83-8c0cc44f5bd5 could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:56:26.282809 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-cf58dee8-9b23-43be-86f9-a6d23e072e58 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5" status: 404 len: 111 microversion: 2.1 time: 0.042873 Aug 09 18:56:26.283958 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 463/893] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:26 2022] GET /compute/v2.1/servers/f349cf3d-5117-4617-ad83-8c0cc44f5bd5 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:56:26.872894 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-441e0773-3858-487e-bff3-dcc06036cfe2 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:26.874993 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-441e0773-3858-487e-bff3-dcc06036cfe2 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:26.883159 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-441e0773-3858-487e-bff3-dcc06036cfe2 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:26.885216 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-441e0773-3858-487e-bff3-dcc06036cfe2 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:26.886137 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-441e0773-3858-487e-bff3-dcc06036cfe2 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:26.887843 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-441e0773-3858-487e-bff3-dcc06036cfe2 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:26.888982 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-441e0773-3858-487e-bff3-dcc06036cfe2 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:26.889975 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-441e0773-3858-487e-bff3-dcc06036cfe2 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:27.053467 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-2eb23719-1103-44e7-b234-339fa89d75ab tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:27.054857 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-2eb23719-1103-44e7-b234-339fa89d75ab tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:27.065033 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2eb23719-1103-44e7-b234-339fa89d75ab tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:27.068217 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2eb23719-1103-44e7-b234-339fa89d75ab tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:27.071440 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2eb23719-1103-44e7-b234-339fa89d75ab tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:27.072391 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2eb23719-1103-44e7-b234-339fa89d75ab tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:27.073119 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2eb23719-1103-44e7-b234-339fa89d75ab tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:27.073823 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2eb23719-1103-44e7-b234-339fa89d75ab tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:27.081817 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-441e0773-3858-487e-bff3-dcc06036cfe2 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:27.094890 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-441e0773-3858-487e-bff3-dcc06036cfe2 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1359 microversion: 2.1 time: 0.225660 Aug 09 18:56:27.094890 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 431/894] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:26 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1359 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:56:27.258919 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-2eb23719-1103-44e7-b234-339fa89d75ab tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:27.279543 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-2eb23719-1103-44e7-b234-339fa89d75ab tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37" status: 200 len: 1318 microversion: 2.1 time: 0.231653 Aug 09 18:56:27.279543 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 464/895] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:27 2022] GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:56:27.587979 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-7df2575c-82d4-4a3e-9657-1dc13926227c tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:27.588480 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-7df2575c-82d4-4a3e-9657-1dc13926227c tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 98218676-0e95-45b0-877f-4b0f7107048c] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:27.594652 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7df2575c-82d4-4a3e-9657-1dc13926227c tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:27.595137 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7df2575c-82d4-4a3e-9657-1dc13926227c tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:27.595576 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7df2575c-82d4-4a3e-9657-1dc13926227c tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:27.596282 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7df2575c-82d4-4a3e-9657-1dc13926227c tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:27.596771 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7df2575c-82d4-4a3e-9657-1dc13926227c tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:27.597775 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7df2575c-82d4-4a3e-9657-1dc13926227c tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:27.611859 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.wsgi [None req-7df2575c-82d4-4a3e-9657-1dc13926227c tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] HTTP exception thrown: Instance 98218676-0e95-45b0-877f-4b0f7107048c could not be found. Aug 09 18:56:27.613452 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-7df2575c-82d4-4a3e-9657-1dc13926227c tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Request method failure captured: Aug 09 18:56:27.613452 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: request: DELETE /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c HTTP/1.1 Aug 09 18:56:27.613452 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept: application/json Aug 09 18:56:27.613452 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept-Encoding: identity Aug 09 18:56:27.613452 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Connection: close Aug 09 18:56:27.613452 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Length: 0 Aug 09 18:56:27.613452 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Type: application/json Aug 09 18:56:27.613452 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Host: 10.222.0.57 Aug 09 18:56:27.613452 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Openstack-System-Scope: None Aug 09 18:56:27.613452 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: User-Agent: python-urllib3/1.26.11 Aug 09 18:56:27.613452 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Auth-Token: gAAAAABi8qxu6GlCXsghs7mXHsJ6lMdriR0lCN6zx0jJtIVa-hoSSpRyn9kABjaS5Ya_Ocw2sU0SEZSB-MC5jyn7nC01Qf-R3Wxc4u_OmCKdxSmXeuRuDoxnEqYVjV6mxSKvywrengnzW8AvtzIMJfiluX7W9B1UousoG9Ld7Q7tERFPOMWrYmI Aug 09 18:56:27.613452 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Id: None Aug 09 18:56:27.613452 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Name: None Aug 09 18:56:27.613452 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Identity-Status: Confirmed Aug 09 18:56:27.613452 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Is-Admin-Project: True Aug 09 18:56:27.613452 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Id: default Aug 09 18:56:27.613452 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Name: Default Aug 09 18:56:27.613452 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Id: 4a745db383cb452187f7c82b9977c09b Aug 09 18:56:27.613452 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Name: tempest-AttachVolumeNegativeTest-1856281892 Aug 09 18:56:27.613452 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Role: reader,member Aug 09 18:56:27.613452 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Roles: reader,member Aug 09 18:56:27.615213 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4a745db383cb452187f7c82b9977c09b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a745db383cb452187f7c82b9977c09b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4a745db383cb452187f7c82b9977c09b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a745db383cb452187f7c82b9977c09b"}]}] Aug 09 18:56:27.615213 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant: tempest-AttachVolumeNegativeTest-1856281892 Aug 09 18:56:27.615213 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Id: 4a745db383cb452187f7c82b9977c09b Aug 09 18:56:27.615213 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1856281892 Aug 09 18:56:27.615213 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User: tempest-AttachVolumeNegativeTest-1856281892-project Aug 09 18:56:27.615213 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Id: default Aug 09 18:56:27.615213 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Name: Default Aug 09 18:56:27.615213 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Id: 00491255f4b44125b6dc9f816c9bbb58 Aug 09 18:56:27.615213 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Name: tempest-AttachVolumeNegativeTest-1856281892-project Aug 09 18:56:27.615213 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: method: > Aug 09 18:56:27.615213 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: exception: Instance 98218676-0e95-45b0-877f-4b0f7107048c could not be found. Aug 09 18:56:27.615213 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: action_args: {'id': '98218676-0e95-45b0-877f-4b0f7107048c'} Aug 09 18:56:27.616637 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:56:27.616637 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:27.616637 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:56:27.616637 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:56:27.616637 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:56:27.616637 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:56:27.616637 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:56:27.616637 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:56:27.616637 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:56:27.616637 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:56:27.616637 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98218676-0e95-45b0-877f-4b0f7107048c could not be found. Aug 09 18:56:27.616637 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:27.616637 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:27.616637 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:27.616637 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:27.616637 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:56:27.616637 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:56:27.616637 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:56:27.616637 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:56:27.616637 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:56:27.617987 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:56:27.617987 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 18:56:27.617987 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 18:56:27.617987 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 18:56:27.617987 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 18:56:27.617987 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:56:27.617987 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:56:27.617987 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:56:27.617987 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:56:27.617987 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98218676-0e95-45b0-877f-4b0f7107048c could not be found. Aug 09 18:56:27.617987 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:27.617987 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:27.617987 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:27.617987 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:27.617987 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:56:27.617987 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:56:27.617987 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:56:27.617987 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:56:27.617987 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98218676-0e95-45b0-877f-4b0f7107048c could not be found. Aug 09 18:56:27.617987 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:27.619674 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-7df2575c-82d4-4a3e-9657-1dc13926227c tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Returning 404 to user: Instance 98218676-0e95-45b0-877f-4b0f7107048c could not be found. {{(pid=124726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:56:27.619674 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-7df2575c-82d4-4a3e-9657-1dc13926227c tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "DELETE /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c" status: 404 len: 111 microversion: 2.1 time: 0.030957 Aug 09 18:56:27.619674 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 432/896] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 9 18:56:27 2022] DELETE /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:56:27.623686 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-8c9abfd0-be57-41ff-a69d-f2c684e05d5a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:27.624296 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-8c9abfd0-be57-41ff-a69d-f2c684e05d5a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 98218676-0e95-45b0-877f-4b0f7107048c] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:27.630225 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8c9abfd0-be57-41ff-a69d-f2c684e05d5a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:27.630913 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8c9abfd0-be57-41ff-a69d-f2c684e05d5a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:27.631357 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8c9abfd0-be57-41ff-a69d-f2c684e05d5a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:27.632066 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8c9abfd0-be57-41ff-a69d-f2c684e05d5a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:27.632518 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8c9abfd0-be57-41ff-a69d-f2c684e05d5a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:27.632937 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8c9abfd0-be57-41ff-a69d-f2c684e05d5a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:27.646807 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-8c9abfd0-be57-41ff-a69d-f2c684e05d5a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] HTTP exception thrown: Instance 98218676-0e95-45b0-877f-4b0f7107048c could not be found. Aug 09 18:56:27.656265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-8c9abfd0-be57-41ff-a69d-f2c684e05d5a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Request method failure captured: Aug 09 18:56:27.656265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: request: GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c HTTP/1.1 Aug 09 18:56:27.656265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept: application/json Aug 09 18:56:27.656265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Aug 09 18:56:27.656265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Connection: close Aug 09 18:56:27.656265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Length: 0 Aug 09 18:56:27.656265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Type: application/json Aug 09 18:56:27.656265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Host: 10.222.0.57 Aug 09 18:56:27.656265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Aug 09 18:56:27.656265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.11 Aug 09 18:56:27.656265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABi8qxu6GlCXsghs7mXHsJ6lMdriR0lCN6zx0jJtIVa-hoSSpRyn9kABjaS5Ya_Ocw2sU0SEZSB-MC5jyn7nC01Qf-R3Wxc4u_OmCKdxSmXeuRuDoxnEqYVjV6mxSKvywrengnzW8AvtzIMJfiluX7W9B1UousoG9Ld7Q7tERFPOMWrYmI Aug 09 18:56:27.656265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Aug 09 18:56:27.656265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Aug 09 18:56:27.656265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Aug 09 18:56:27.656265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Aug 09 18:56:27.656265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Aug 09 18:56:27.656265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Aug 09 18:56:27.656265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Id: 4a745db383cb452187f7c82b9977c09b Aug 09 18:56:27.656265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-AttachVolumeNegativeTest-1856281892 Aug 09 18:56:27.656265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Role: reader,member Aug 09 18:56:27.656265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Roles: reader,member Aug 09 18:56:27.657892 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4a745db383cb452187f7c82b9977c09b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a745db383cb452187f7c82b9977c09b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4a745db383cb452187f7c82b9977c09b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a745db383cb452187f7c82b9977c09b"}]}] Aug 09 18:56:27.657892 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-AttachVolumeNegativeTest-1856281892 Aug 09 18:56:27.657892 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 4a745db383cb452187f7c82b9977c09b Aug 09 18:56:27.657892 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1856281892 Aug 09 18:56:27.657892 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User: tempest-AttachVolumeNegativeTest-1856281892-project Aug 09 18:56:27.657892 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Aug 09 18:56:27.657892 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Aug 09 18:56:27.657892 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Id: 00491255f4b44125b6dc9f816c9bbb58 Aug 09 18:56:27.657892 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-AttachVolumeNegativeTest-1856281892-project Aug 09 18:56:27.657892 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: method: > Aug 09 18:56:27.657892 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: exception: Instance 98218676-0e95-45b0-877f-4b0f7107048c could not be found. Aug 09 18:56:27.657892 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: action_args: {'id': '98218676-0e95-45b0-877f-4b0f7107048c'} Aug 09 18:56:27.658799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:56:27.658799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:27.658799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:56:27.658799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:56:27.658799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:56:27.658799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:56:27.658799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:56:27.658799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:56:27.658799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:56:27.658799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:56:27.658799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98218676-0e95-45b0-877f-4b0f7107048c could not be found. Aug 09 18:56:27.658799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:27.658799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:27.658799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:27.658799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:27.658799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:56:27.658799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:56:27.658799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:56:27.658799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:56:27.658799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:56:27.660883 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:56:27.660883 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:56:27.660883 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:56:27.660883 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:56:27.660883 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:56:27.660883 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:56:27.660883 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:56:27.660883 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98218676-0e95-45b0-877f-4b0f7107048c could not be found. Aug 09 18:56:27.660883 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:27.660883 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:27.660883 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:27.660883 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:27.660883 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:56:27.660883 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:56:27.660883 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:56:27.660883 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:56:27.660883 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98218676-0e95-45b0-877f-4b0f7107048c could not be found. Aug 09 18:56:27.660883 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:27.662386 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-8c9abfd0-be57-41ff-a69d-f2c684e05d5a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Returning 404 to user: Instance 98218676-0e95-45b0-877f-4b0f7107048c could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:56:27.662386 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-8c9abfd0-be57-41ff-a69d-f2c684e05d5a tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c" status: 404 len: 111 microversion: 2.1 time: 0.030014 Aug 09 18:56:27.662386 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 465/897] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:27 2022] GET /compute/v2.1/servers/98218676-0e95-45b0-877f-4b0f7107048c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:56:27.663620 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-436aa824-9dc7-43dd-ae20-2de48b51cf43 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:27.664123 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-436aa824-9dc7-43dd-ae20-2de48b51cf43 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 6ba05bdf-8754-4e31-976a-816a4485a252] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:27.670223 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-436aa824-9dc7-43dd-ae20-2de48b51cf43 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:27.670701 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-436aa824-9dc7-43dd-ae20-2de48b51cf43 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:27.671138 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-436aa824-9dc7-43dd-ae20-2de48b51cf43 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:27.672114 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-436aa824-9dc7-43dd-ae20-2de48b51cf43 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:27.672286 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-436aa824-9dc7-43dd-ae20-2de48b51cf43 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:27.672711 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-436aa824-9dc7-43dd-ae20-2de48b51cf43 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:27.686404 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.wsgi [None req-436aa824-9dc7-43dd-ae20-2de48b51cf43 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] HTTP exception thrown: Instance 6ba05bdf-8754-4e31-976a-816a4485a252 could not be found. Aug 09 18:56:27.688045 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-436aa824-9dc7-43dd-ae20-2de48b51cf43 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Request method failure captured: Aug 09 18:56:27.688045 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: request: DELETE /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252 HTTP/1.1 Aug 09 18:56:27.688045 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept: application/json Aug 09 18:56:27.688045 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept-Encoding: identity Aug 09 18:56:27.688045 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Connection: close Aug 09 18:56:27.688045 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Length: 0 Aug 09 18:56:27.688045 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Type: application/json Aug 09 18:56:27.688045 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Host: 10.222.0.57 Aug 09 18:56:27.688045 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Openstack-System-Scope: None Aug 09 18:56:27.688045 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: User-Agent: python-urllib3/1.26.11 Aug 09 18:56:27.688045 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Auth-Token: gAAAAABi8qxu6GlCXsghs7mXHsJ6lMdriR0lCN6zx0jJtIVa-hoSSpRyn9kABjaS5Ya_Ocw2sU0SEZSB-MC5jyn7nC01Qf-R3Wxc4u_OmCKdxSmXeuRuDoxnEqYVjV6mxSKvywrengnzW8AvtzIMJfiluX7W9B1UousoG9Ld7Q7tERFPOMWrYmI Aug 09 18:56:27.688045 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Id: None Aug 09 18:56:27.688045 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Name: None Aug 09 18:56:27.688045 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Identity-Status: Confirmed Aug 09 18:56:27.688045 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Is-Admin-Project: True Aug 09 18:56:27.688045 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Id: default Aug 09 18:56:27.688045 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Name: Default Aug 09 18:56:27.688045 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Id: 4a745db383cb452187f7c82b9977c09b Aug 09 18:56:27.688045 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Name: tempest-AttachVolumeNegativeTest-1856281892 Aug 09 18:56:27.688045 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Role: reader,member Aug 09 18:56:27.688045 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Roles: reader,member Aug 09 18:56:27.689755 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4a745db383cb452187f7c82b9977c09b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a745db383cb452187f7c82b9977c09b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4a745db383cb452187f7c82b9977c09b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a745db383cb452187f7c82b9977c09b"}]}] Aug 09 18:56:27.689755 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant: tempest-AttachVolumeNegativeTest-1856281892 Aug 09 18:56:27.689755 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Id: 4a745db383cb452187f7c82b9977c09b Aug 09 18:56:27.689755 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1856281892 Aug 09 18:56:27.689755 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User: tempest-AttachVolumeNegativeTest-1856281892-project Aug 09 18:56:27.689755 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Id: default Aug 09 18:56:27.689755 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Name: Default Aug 09 18:56:27.689755 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Id: 00491255f4b44125b6dc9f816c9bbb58 Aug 09 18:56:27.689755 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Name: tempest-AttachVolumeNegativeTest-1856281892-project Aug 09 18:56:27.689755 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: method: > Aug 09 18:56:27.689755 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: exception: Instance 6ba05bdf-8754-4e31-976a-816a4485a252 could not be found. Aug 09 18:56:27.689755 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: action_args: {'id': '6ba05bdf-8754-4e31-976a-816a4485a252'} Aug 09 18:56:27.690830 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:56:27.690830 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:27.690830 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:56:27.690830 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:56:27.690830 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:56:27.690830 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:56:27.690830 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:56:27.690830 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:56:27.690830 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:56:27.690830 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:56:27.690830 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ba05bdf-8754-4e31-976a-816a4485a252 could not be found. Aug 09 18:56:27.690830 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:27.690830 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:27.690830 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:27.690830 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:27.690830 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:56:27.690830 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:56:27.690830 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:56:27.690830 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:56:27.690830 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:56:27.692284 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:56:27.692284 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 18:56:27.692284 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 18:56:27.692284 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 18:56:27.692284 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 18:56:27.692284 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:56:27.692284 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:56:27.692284 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:56:27.692284 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:56:27.692284 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ba05bdf-8754-4e31-976a-816a4485a252 could not be found. Aug 09 18:56:27.692284 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:27.692284 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:27.692284 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:27.692284 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:27.692284 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:56:27.692284 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:56:27.692284 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:56:27.692284 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:56:27.692284 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ba05bdf-8754-4e31-976a-816a4485a252 could not be found. Aug 09 18:56:27.692284 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:27.693959 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-436aa824-9dc7-43dd-ae20-2de48b51cf43 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Returning 404 to user: Instance 6ba05bdf-8754-4e31-976a-816a4485a252 could not be found. {{(pid=124726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:56:27.693959 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-436aa824-9dc7-43dd-ae20-2de48b51cf43 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "DELETE /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252" status: 404 len: 111 microversion: 2.1 time: 0.030199 Aug 09 18:56:27.693959 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 433/898] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 9 18:56:27 2022] DELETE /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:56:27.698398 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d60ae855-0fbd-4435-a63c-c4d0e576ded8 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:27.699006 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-d60ae855-0fbd-4435-a63c-c4d0e576ded8 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 6ba05bdf-8754-4e31-976a-816a4485a252] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:27.705131 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d60ae855-0fbd-4435-a63c-c4d0e576ded8 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:27.705641 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d60ae855-0fbd-4435-a63c-c4d0e576ded8 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:27.706655 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d60ae855-0fbd-4435-a63c-c4d0e576ded8 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:27.707346 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d60ae855-0fbd-4435-a63c-c4d0e576ded8 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:27.707797 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d60ae855-0fbd-4435-a63c-c4d0e576ded8 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:27.708222 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d60ae855-0fbd-4435-a63c-c4d0e576ded8 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:27.722600 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-d60ae855-0fbd-4435-a63c-c4d0e576ded8 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] HTTP exception thrown: Instance 6ba05bdf-8754-4e31-976a-816a4485a252 could not be found. Aug 09 18:56:27.723799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d60ae855-0fbd-4435-a63c-c4d0e576ded8 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Request method failure captured: Aug 09 18:56:27.723799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: request: GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252 HTTP/1.1 Aug 09 18:56:27.723799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept: application/json Aug 09 18:56:27.723799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Aug 09 18:56:27.723799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Connection: close Aug 09 18:56:27.723799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Length: 0 Aug 09 18:56:27.723799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Type: application/json Aug 09 18:56:27.723799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Host: 10.222.0.57 Aug 09 18:56:27.723799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Aug 09 18:56:27.723799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.11 Aug 09 18:56:27.723799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABi8qxu6GlCXsghs7mXHsJ6lMdriR0lCN6zx0jJtIVa-hoSSpRyn9kABjaS5Ya_Ocw2sU0SEZSB-MC5jyn7nC01Qf-R3Wxc4u_OmCKdxSmXeuRuDoxnEqYVjV6mxSKvywrengnzW8AvtzIMJfiluX7W9B1UousoG9Ld7Q7tERFPOMWrYmI Aug 09 18:56:27.723799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Aug 09 18:56:27.723799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Aug 09 18:56:27.723799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Aug 09 18:56:27.723799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Aug 09 18:56:27.723799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Aug 09 18:56:27.723799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Aug 09 18:56:27.723799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Id: 4a745db383cb452187f7c82b9977c09b Aug 09 18:56:27.723799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-AttachVolumeNegativeTest-1856281892 Aug 09 18:56:27.723799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Role: reader,member Aug 09 18:56:27.723799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Roles: reader,member Aug 09 18:56:27.725612 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4a745db383cb452187f7c82b9977c09b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a745db383cb452187f7c82b9977c09b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4a745db383cb452187f7c82b9977c09b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a745db383cb452187f7c82b9977c09b"}]}] Aug 09 18:56:27.725612 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-AttachVolumeNegativeTest-1856281892 Aug 09 18:56:27.725612 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 4a745db383cb452187f7c82b9977c09b Aug 09 18:56:27.725612 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1856281892 Aug 09 18:56:27.725612 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User: tempest-AttachVolumeNegativeTest-1856281892-project Aug 09 18:56:27.725612 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Aug 09 18:56:27.725612 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Aug 09 18:56:27.725612 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Id: 00491255f4b44125b6dc9f816c9bbb58 Aug 09 18:56:27.725612 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-AttachVolumeNegativeTest-1856281892-project Aug 09 18:56:27.725612 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: method: > Aug 09 18:56:27.725612 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: exception: Instance 6ba05bdf-8754-4e31-976a-816a4485a252 could not be found. Aug 09 18:56:27.725612 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: action_args: {'id': '6ba05bdf-8754-4e31-976a-816a4485a252'} Aug 09 18:56:27.726526 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:56:27.726526 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:27.726526 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:56:27.726526 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:56:27.726526 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:56:27.726526 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:56:27.726526 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:56:27.726526 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:56:27.726526 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:56:27.726526 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:56:27.726526 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ba05bdf-8754-4e31-976a-816a4485a252 could not be found. Aug 09 18:56:27.726526 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:27.726526 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:27.726526 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:27.726526 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:27.726526 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:56:27.726526 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:56:27.726526 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:56:27.726526 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:56:27.726526 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:56:27.727976 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:56:27.727976 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:56:27.727976 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:56:27.727976 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:56:27.727976 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:56:27.727976 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:56:27.727976 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:56:27.727976 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ba05bdf-8754-4e31-976a-816a4485a252 could not be found. Aug 09 18:56:27.727976 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:27.727976 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:27.727976 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:27.727976 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:27.727976 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:56:27.727976 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:56:27.727976 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:56:27.727976 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:56:27.727976 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ba05bdf-8754-4e31-976a-816a4485a252 could not be found. Aug 09 18:56:27.727976 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:27.729400 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d60ae855-0fbd-4435-a63c-c4d0e576ded8 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Returning 404 to user: Instance 6ba05bdf-8754-4e31-976a-816a4485a252 could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:56:27.729400 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-d60ae855-0fbd-4435-a63c-c4d0e576ded8 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252" status: 404 len: 111 microversion: 2.1 time: 0.030662 Aug 09 18:56:27.729400 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 466/899] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:27 2022] GET /compute/v2.1/servers/6ba05bdf-8754-4e31-976a-816a4485a252 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:56:28.116023 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-72b4fa57-172f-4177-aaad-44d8ee37d561 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:28.116614 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-72b4fa57-172f-4177-aaad-44d8ee37d561 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:28.122990 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-72b4fa57-172f-4177-aaad-44d8ee37d561 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:28.123471 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-72b4fa57-172f-4177-aaad-44d8ee37d561 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:28.123905 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-72b4fa57-172f-4177-aaad-44d8ee37d561 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:28.124592 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-72b4fa57-172f-4177-aaad-44d8ee37d561 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:28.125131 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-72b4fa57-172f-4177-aaad-44d8ee37d561 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:28.125819 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-72b4fa57-172f-4177-aaad-44d8ee37d561 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:28.300566 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-87094f46-29cb-4499-bd04-43d5ebcb60f1 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:28.302149 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-87094f46-29cb-4499-bd04-43d5ebcb60f1 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:28.308625 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-87094f46-29cb-4499-bd04-43d5ebcb60f1 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:28.309190 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-87094f46-29cb-4499-bd04-43d5ebcb60f1 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:28.309645 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-87094f46-29cb-4499-bd04-43d5ebcb60f1 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:28.310350 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-87094f46-29cb-4499-bd04-43d5ebcb60f1 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:28.311065 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-87094f46-29cb-4499-bd04-43d5ebcb60f1 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:28.312004 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-87094f46-29cb-4499-bd04-43d5ebcb60f1 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:28.374916 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-72b4fa57-172f-4177-aaad-44d8ee37d561 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:28.383230 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-72b4fa57-172f-4177-aaad-44d8ee37d561 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1359 microversion: 2.1 time: 0.271167 Aug 09 18:56:28.383869 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 434/900] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:28 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1359 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:56:28.455906 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-87094f46-29cb-4499-bd04-43d5ebcb60f1 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:28.463361 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-87094f46-29cb-4499-bd04-43d5ebcb60f1 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37" status: 200 len: 1318 microversion: 2.1 time: 0.167438 Aug 09 18:56:28.463920 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 467/901] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:28 2022] GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:56:29.067754 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-41e7e3ca-b0a8-422f-8332-8e51d805d430 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:29.068250 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-41e7e3ca-b0a8-422f-8332-8e51d805d430 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:29.074643 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-41e7e3ca-b0a8-422f-8332-8e51d805d430 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:29.075122 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-41e7e3ca-b0a8-422f-8332-8e51d805d430 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:29.075554 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-41e7e3ca-b0a8-422f-8332-8e51d805d430 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:29.076242 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-41e7e3ca-b0a8-422f-8332-8e51d805d430 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:29.076692 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-41e7e3ca-b0a8-422f-8332-8e51d805d430 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:29.077113 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-41e7e3ca-b0a8-422f-8332-8e51d805d430 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:29.090780 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.wsgi [None req-41e7e3ca-b0a8-422f-8332-8e51d805d430 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] HTTP exception thrown: Instance 743aafc6-1787-4c6e-be09-3b460a00d5e9 could not be found. Aug 09 18:56:29.092315 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-41e7e3ca-b0a8-422f-8332-8e51d805d430 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Request method failure captured: Aug 09 18:56:29.092315 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: request: DELETE /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9 HTTP/1.1 Aug 09 18:56:29.092315 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept: application/json Aug 09 18:56:29.092315 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept-Encoding: identity Aug 09 18:56:29.092315 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Connection: close Aug 09 18:56:29.092315 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Length: 0 Aug 09 18:56:29.092315 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Type: application/json Aug 09 18:56:29.092315 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Host: 10.222.0.57 Aug 09 18:56:29.092315 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Openstack-System-Scope: None Aug 09 18:56:29.092315 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: User-Agent: python-urllib3/1.26.11 Aug 09 18:56:29.092315 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Auth-Token: gAAAAABi8qxu6GlCXsghs7mXHsJ6lMdriR0lCN6zx0jJtIVa-hoSSpRyn9kABjaS5Ya_Ocw2sU0SEZSB-MC5jyn7nC01Qf-R3Wxc4u_OmCKdxSmXeuRuDoxnEqYVjV6mxSKvywrengnzW8AvtzIMJfiluX7W9B1UousoG9Ld7Q7tERFPOMWrYmI Aug 09 18:56:29.092315 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Id: None Aug 09 18:56:29.092315 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Name: None Aug 09 18:56:29.092315 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Identity-Status: Confirmed Aug 09 18:56:29.092315 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Is-Admin-Project: True Aug 09 18:56:29.092315 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Id: default Aug 09 18:56:29.092315 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Name: Default Aug 09 18:56:29.092315 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Id: 4a745db383cb452187f7c82b9977c09b Aug 09 18:56:29.092315 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Name: tempest-AttachVolumeNegativeTest-1856281892 Aug 09 18:56:29.092315 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Role: reader,member Aug 09 18:56:29.092315 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Roles: reader,member Aug 09 18:56:29.093869 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4a745db383cb452187f7c82b9977c09b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a745db383cb452187f7c82b9977c09b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4a745db383cb452187f7c82b9977c09b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a745db383cb452187f7c82b9977c09b"}]}] Aug 09 18:56:29.093869 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant: tempest-AttachVolumeNegativeTest-1856281892 Aug 09 18:56:29.093869 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Id: 4a745db383cb452187f7c82b9977c09b Aug 09 18:56:29.093869 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1856281892 Aug 09 18:56:29.093869 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User: tempest-AttachVolumeNegativeTest-1856281892-project Aug 09 18:56:29.093869 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Id: default Aug 09 18:56:29.093869 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Name: Default Aug 09 18:56:29.093869 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Id: 00491255f4b44125b6dc9f816c9bbb58 Aug 09 18:56:29.093869 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Name: tempest-AttachVolumeNegativeTest-1856281892-project Aug 09 18:56:29.093869 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: method: > Aug 09 18:56:29.093869 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: exception: Instance 743aafc6-1787-4c6e-be09-3b460a00d5e9 could not be found. Aug 09 18:56:29.093869 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: action_args: {'id': '743aafc6-1787-4c6e-be09-3b460a00d5e9'} Aug 09 18:56:29.094822 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:56:29.094822 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:29.094822 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:56:29.094822 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:56:29.094822 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:56:29.094822 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:56:29.094822 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:56:29.094822 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:56:29.094822 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:56:29.094822 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:56:29.094822 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 743aafc6-1787-4c6e-be09-3b460a00d5e9 could not be found. Aug 09 18:56:29.094822 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:29.094822 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:29.094822 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:29.094822 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:29.094822 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:56:29.094822 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:56:29.094822 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:56:29.094822 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:56:29.094822 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:56:29.096020 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:56:29.096020 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 18:56:29.096020 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 18:56:29.096020 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 18:56:29.096020 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 18:56:29.096020 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:56:29.096020 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:56:29.096020 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:56:29.096020 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:56:29.096020 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 743aafc6-1787-4c6e-be09-3b460a00d5e9 could not be found. Aug 09 18:56:29.096020 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:29.096020 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:29.096020 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:29.096020 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:29.096020 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:56:29.096020 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:56:29.096020 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:56:29.096020 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:56:29.096020 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 743aafc6-1787-4c6e-be09-3b460a00d5e9 could not be found. Aug 09 18:56:29.096020 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:56:29.097958 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-41e7e3ca-b0a8-422f-8332-8e51d805d430 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Returning 404 to user: Instance 743aafc6-1787-4c6e-be09-3b460a00d5e9 could not be found. {{(pid=124726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:56:29.097958 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-41e7e3ca-b0a8-422f-8332-8e51d805d430 tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "DELETE /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9" status: 404 len: 111 microversion: 2.1 time: 0.029753 Aug 09 18:56:29.097958 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 435/902] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 9 18:56:29 2022] DELETE /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:56:29.102705 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-631e9df5-accc-4032-a503-29494c4256bd tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:29.103311 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-631e9df5-accc-4032-a503-29494c4256bd tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] [instance: 743aafc6-1787-4c6e-be09-3b460a00d5e9] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:29.109221 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-631e9df5-accc-4032-a503-29494c4256bd tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:29.109802 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-631e9df5-accc-4032-a503-29494c4256bd tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:29.110232 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-631e9df5-accc-4032-a503-29494c4256bd tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:29.110916 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-631e9df5-accc-4032-a503-29494c4256bd tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:29.111361 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-631e9df5-accc-4032-a503-29494c4256bd tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:29.111775 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-631e9df5-accc-4032-a503-29494c4256bd tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:29.125288 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-631e9df5-accc-4032-a503-29494c4256bd tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] HTTP exception thrown: Instance 743aafc6-1787-4c6e-be09-3b460a00d5e9 could not be found. Aug 09 18:56:29.126872 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-631e9df5-accc-4032-a503-29494c4256bd tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Request method failure captured: Aug 09 18:56:29.126872 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: request: GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9 HTTP/1.1 Aug 09 18:56:29.126872 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept: application/json Aug 09 18:56:29.126872 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Aug 09 18:56:29.126872 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Connection: close Aug 09 18:56:29.126872 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Length: 0 Aug 09 18:56:29.126872 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Type: application/json Aug 09 18:56:29.126872 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Host: 10.222.0.57 Aug 09 18:56:29.126872 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Aug 09 18:56:29.126872 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.11 Aug 09 18:56:29.126872 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABi8qxu6GlCXsghs7mXHsJ6lMdriR0lCN6zx0jJtIVa-hoSSpRyn9kABjaS5Ya_Ocw2sU0SEZSB-MC5jyn7nC01Qf-R3Wxc4u_OmCKdxSmXeuRuDoxnEqYVjV6mxSKvywrengnzW8AvtzIMJfiluX7W9B1UousoG9Ld7Q7tERFPOMWrYmI Aug 09 18:56:29.126872 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Aug 09 18:56:29.126872 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Aug 09 18:56:29.126872 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Aug 09 18:56:29.126872 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Aug 09 18:56:29.126872 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Aug 09 18:56:29.126872 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Aug 09 18:56:29.126872 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Id: 4a745db383cb452187f7c82b9977c09b Aug 09 18:56:29.126872 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-AttachVolumeNegativeTest-1856281892 Aug 09 18:56:29.126872 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Role: reader,member Aug 09 18:56:29.126872 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Roles: reader,member Aug 09 18:56:29.128419 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4a745db383cb452187f7c82b9977c09b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a745db383cb452187f7c82b9977c09b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4a745db383cb452187f7c82b9977c09b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a745db383cb452187f7c82b9977c09b"}]}] Aug 09 18:56:29.128419 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-AttachVolumeNegativeTest-1856281892 Aug 09 18:56:29.128419 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 4a745db383cb452187f7c82b9977c09b Aug 09 18:56:29.128419 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1856281892 Aug 09 18:56:29.128419 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User: tempest-AttachVolumeNegativeTest-1856281892-project Aug 09 18:56:29.128419 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Aug 09 18:56:29.128419 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Aug 09 18:56:29.128419 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Id: 00491255f4b44125b6dc9f816c9bbb58 Aug 09 18:56:29.128419 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-AttachVolumeNegativeTest-1856281892-project Aug 09 18:56:29.128419 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: method: > Aug 09 18:56:29.128419 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: exception: Instance 743aafc6-1787-4c6e-be09-3b460a00d5e9 could not be found. Aug 09 18:56:29.128419 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: action_args: {'id': '743aafc6-1787-4c6e-be09-3b460a00d5e9'} Aug 09 18:56:29.129441 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:56:29.129441 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:29.129441 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:56:29.129441 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:56:29.129441 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:56:29.129441 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:56:29.129441 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:56:29.129441 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:56:29.129441 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:56:29.129441 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:56:29.129441 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 743aafc6-1787-4c6e-be09-3b460a00d5e9 could not be found. Aug 09 18:56:29.129441 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:29.129441 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:29.129441 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:29.129441 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:29.129441 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:56:29.129441 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:56:29.129441 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:56:29.129441 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:56:29.129441 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:56:29.131138 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:56:29.131138 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:56:29.131138 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:56:29.131138 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:56:29.131138 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:56:29.131138 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:56:29.131138 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:56:29.131138 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 743aafc6-1787-4c6e-be09-3b460a00d5e9 could not be found. Aug 09 18:56:29.131138 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:29.131138 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:56:29.131138 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:29.131138 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:56:29.131138 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:56:29.131138 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:56:29.131138 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:56:29.131138 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:56:29.131138 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 743aafc6-1787-4c6e-be09-3b460a00d5e9 could not be found. Aug 09 18:56:29.131138 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:56:29.133986 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-631e9df5-accc-4032-a503-29494c4256bd tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] Returning 404 to user: Instance 743aafc6-1787-4c6e-be09-3b460a00d5e9 could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:56:29.133986 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-631e9df5-accc-4032-a503-29494c4256bd tempest-AttachVolumeNegativeTest-1856281892 tempest-AttachVolumeNegativeTest-1856281892-project] 10.222.0.57 "GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9" status: 404 len: 111 microversion: 2.1 time: 0.029335 Aug 09 18:56:29.133986 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 468/903] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:29 2022] GET /compute/v2.1/servers/743aafc6-1787-4c6e-be09-3b460a00d5e9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:56:29.404826 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-c076973e-cfdb-42d1-bc0e-a713e5260f29 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:29.405358 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-c076973e-cfdb-42d1-bc0e-a713e5260f29 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:29.412013 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c076973e-cfdb-42d1-bc0e-a713e5260f29 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:29.412518 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c076973e-cfdb-42d1-bc0e-a713e5260f29 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:29.412971 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c076973e-cfdb-42d1-bc0e-a713e5260f29 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:29.413681 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c076973e-cfdb-42d1-bc0e-a713e5260f29 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:29.414140 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c076973e-cfdb-42d1-bc0e-a713e5260f29 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:29.414561 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c076973e-cfdb-42d1-bc0e-a713e5260f29 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:29.483943 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-891b0389-a8fe-4410-8a8c-e34006d5b32f tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:29.484509 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-891b0389-a8fe-4410-8a8c-e34006d5b32f tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:29.490847 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-891b0389-a8fe-4410-8a8c-e34006d5b32f tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:29.491620 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-891b0389-a8fe-4410-8a8c-e34006d5b32f tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:29.491766 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-891b0389-a8fe-4410-8a8c-e34006d5b32f tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:29.492478 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-891b0389-a8fe-4410-8a8c-e34006d5b32f tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:29.492922 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-891b0389-a8fe-4410-8a8c-e34006d5b32f tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:29.493345 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-891b0389-a8fe-4410-8a8c-e34006d5b32f tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:29.627044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-891b0389-a8fe-4410-8a8c-e34006d5b32f tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:29.635538 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-891b0389-a8fe-4410-8a8c-e34006d5b32f tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37" status: 200 len: 1318 microversion: 2.1 time: 0.155447 Aug 09 18:56:29.636479 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 469/904] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:29 2022] GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:56:29.639025 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-c076973e-cfdb-42d1-bc0e-a713e5260f29 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:29.647317 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-c076973e-cfdb-42d1-bc0e-a713e5260f29 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1359 microversion: 2.1 time: 0.246875 Aug 09 18:56:29.647965 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 436/905] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:29 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1359 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:56:30.663438 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-441f2981-68f1-4fef-afbb-feb8949550b8 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:30.664045 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-441f2981-68f1-4fef-afbb-feb8949550b8 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:30.667517 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-22c6517b-396d-4cb8-bf95-2dc61056f866 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:30.667933 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-22c6517b-396d-4cb8-bf95-2dc61056f866 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:30.670566 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-441f2981-68f1-4fef-afbb-feb8949550b8 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:30.671046 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-441f2981-68f1-4fef-afbb-feb8949550b8 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:30.672036 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-441f2981-68f1-4fef-afbb-feb8949550b8 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:30.672873 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-441f2981-68f1-4fef-afbb-feb8949550b8 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:30.673487 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-441f2981-68f1-4fef-afbb-feb8949550b8 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:30.673940 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-441f2981-68f1-4fef-afbb-feb8949550b8 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:30.675122 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-22c6517b-396d-4cb8-bf95-2dc61056f866 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:30.675667 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-22c6517b-396d-4cb8-bf95-2dc61056f866 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:30.676266 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-22c6517b-396d-4cb8-bf95-2dc61056f866 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:30.676967 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-22c6517b-396d-4cb8-bf95-2dc61056f866 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:30.677423 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-22c6517b-396d-4cb8-bf95-2dc61056f866 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:30.678030 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-22c6517b-396d-4cb8-bf95-2dc61056f866 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:30.813480 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-441f2981-68f1-4fef-afbb-feb8949550b8 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:30.821423 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-441f2981-68f1-4fef-afbb-feb8949550b8 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37" status: 200 len: 1318 microversion: 2.1 time: 0.162440 Aug 09 18:56:30.822026 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 470/906] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:30 2022] GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:56:30.892650 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-22c6517b-396d-4cb8-bf95-2dc61056f866 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:30.901586 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-22c6517b-396d-4cb8-bf95-2dc61056f866 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1359 microversion: 2.1 time: 0.238321 Aug 09 18:56:30.902168 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 437/907] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:30 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1359 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:56:31.843969 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-61f7e756-2335-48f0-a79a-a51314c3cba4 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:31.844872 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-61f7e756-2335-48f0-a79a-a51314c3cba4 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:31.852672 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-61f7e756-2335-48f0-a79a-a51314c3cba4 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:31.853293 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-61f7e756-2335-48f0-a79a-a51314c3cba4 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:31.853808 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-61f7e756-2335-48f0-a79a-a51314c3cba4 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:31.854508 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-61f7e756-2335-48f0-a79a-a51314c3cba4 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:31.854964 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-61f7e756-2335-48f0-a79a-a51314c3cba4 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:31.855388 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-61f7e756-2335-48f0-a79a-a51314c3cba4 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:31.922676 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-0cf0058f-42df-4325-b19d-10c7c6a1f4d5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:31.924141 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-0cf0058f-42df-4325-b19d-10c7c6a1f4d5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:31.933169 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0cf0058f-42df-4325-b19d-10c7c6a1f4d5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:31.934070 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0cf0058f-42df-4325-b19d-10c7c6a1f4d5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:31.934518 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0cf0058f-42df-4325-b19d-10c7c6a1f4d5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:31.935418 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0cf0058f-42df-4325-b19d-10c7c6a1f4d5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:31.936347 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0cf0058f-42df-4325-b19d-10c7c6a1f4d5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:31.936946 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0cf0058f-42df-4325-b19d-10c7c6a1f4d5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:32.013465 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-61f7e756-2335-48f0-a79a-a51314c3cba4 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:32.021331 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-61f7e756-2335-48f0-a79a-a51314c3cba4 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37" status: 200 len: 1318 microversion: 2.1 time: 0.182259 Aug 09 18:56:32.021958 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 471/908] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:31 2022] GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:56:32.111572 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-0cf0058f-42df-4325-b19d-10c7c6a1f4d5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:32.119230 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-0cf0058f-42df-4325-b19d-10c7c6a1f4d5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1359 microversion: 2.1 time: 0.201112 Aug 09 18:56:32.119804 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 438/909] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:31 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1359 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:56:33.047777 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-ada31b78-dc79-4d5a-b347-7a173099e220 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:33.048348 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-ada31b78-dc79-4d5a-b347-7a173099e220 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:33.055239 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ada31b78-dc79-4d5a-b347-7a173099e220 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:33.055722 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ada31b78-dc79-4d5a-b347-7a173099e220 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:33.056159 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ada31b78-dc79-4d5a-b347-7a173099e220 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:33.056926 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ada31b78-dc79-4d5a-b347-7a173099e220 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:33.057380 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ada31b78-dc79-4d5a-b347-7a173099e220 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:33.057830 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ada31b78-dc79-4d5a-b347-7a173099e220 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:33.141047 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-15c87c7f-9256-448b-9115-7b99baef067b tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:33.142413 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-15c87c7f-9256-448b-9115-7b99baef067b tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:33.150718 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-15c87c7f-9256-448b-9115-7b99baef067b tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:33.151215 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-15c87c7f-9256-448b-9115-7b99baef067b tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:33.151644 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-15c87c7f-9256-448b-9115-7b99baef067b tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:33.152432 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-15c87c7f-9256-448b-9115-7b99baef067b tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:33.152882 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-15c87c7f-9256-448b-9115-7b99baef067b tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:33.153305 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-15c87c7f-9256-448b-9115-7b99baef067b tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:33.209301 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-ada31b78-dc79-4d5a-b347-7a173099e220 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:33.217261 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-ada31b78-dc79-4d5a-b347-7a173099e220 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37" status: 200 len: 1318 microversion: 2.1 time: 0.173328 Aug 09 18:56:33.218096 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 472/910] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:33 2022] GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:56:33.411347 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-15c87c7f-9256-448b-9115-7b99baef067b tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:33.420703 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-15c87c7f-9256-448b-9115-7b99baef067b tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1359 microversion: 2.1 time: 0.284112 Aug 09 18:56:33.421278 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 439/911] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:33 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1359 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:56:34.238604 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b8b8fed2-bc6c-4504-b9e9-fe6a24320c3e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:34.239238 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-b8b8fed2-bc6c-4504-b9e9-fe6a24320c3e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:34.245907 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b8b8fed2-bc6c-4504-b9e9-fe6a24320c3e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:34.246470 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b8b8fed2-bc6c-4504-b9e9-fe6a24320c3e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:34.246978 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b8b8fed2-bc6c-4504-b9e9-fe6a24320c3e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:34.247740 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b8b8fed2-bc6c-4504-b9e9-fe6a24320c3e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:34.248271 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b8b8fed2-bc6c-4504-b9e9-fe6a24320c3e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:34.248789 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b8b8fed2-bc6c-4504-b9e9-fe6a24320c3e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:34.405712 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-b8b8fed2-bc6c-4504-b9e9-fe6a24320c3e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:34.413929 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-b8b8fed2-bc6c-4504-b9e9-fe6a24320c3e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37" status: 200 len: 1318 microversion: 2.1 time: 0.179279 Aug 09 18:56:34.414514 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 473/912] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:34 2022] GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:56:34.442322 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-d3dbfa4c-cb76-4983-832d-6f0d0820dc6c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:34.442957 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-d3dbfa4c-cb76-4983-832d-6f0d0820dc6c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:34.449792 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d3dbfa4c-cb76-4983-832d-6f0d0820dc6c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:34.450496 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d3dbfa4c-cb76-4983-832d-6f0d0820dc6c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:34.450934 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d3dbfa4c-cb76-4983-832d-6f0d0820dc6c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:34.451633 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d3dbfa4c-cb76-4983-832d-6f0d0820dc6c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:34.452079 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d3dbfa4c-cb76-4983-832d-6f0d0820dc6c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:34.452492 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d3dbfa4c-cb76-4983-832d-6f0d0820dc6c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:34.615938 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-d3dbfa4c-cb76-4983-832d-6f0d0820dc6c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:34.623974 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-d3dbfa4c-cb76-4983-832d-6f0d0820dc6c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1359 microversion: 2.1 time: 0.185598 Aug 09 18:56:34.624660 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 440/913] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:34 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:56:35.434634 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-dafff6ee-c2fd-42cd-a24d-4090b4f578af tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:35.435243 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-dafff6ee-c2fd-42cd-a24d-4090b4f578af tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:35.442650 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dafff6ee-c2fd-42cd-a24d-4090b4f578af tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:35.443907 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dafff6ee-c2fd-42cd-a24d-4090b4f578af tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:35.443907 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dafff6ee-c2fd-42cd-a24d-4090b4f578af tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:35.444302 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dafff6ee-c2fd-42cd-a24d-4090b4f578af tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:35.444744 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dafff6ee-c2fd-42cd-a24d-4090b4f578af tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:35.445167 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dafff6ee-c2fd-42cd-a24d-4090b4f578af tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:35.587295 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-dafff6ee-c2fd-42cd-a24d-4090b4f578af tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:35.596320 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-dafff6ee-c2fd-42cd-a24d-4090b4f578af tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37" status: 200 len: 1318 microversion: 2.1 time: 0.165459 Aug 09 18:56:35.597475 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 474/914] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:35 2022] GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:56:35.646589 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-bd92c95f-adc7-4f01-aa95-f338c7bc6a86 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:35.647342 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-bd92c95f-adc7-4f01-aa95-f338c7bc6a86 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:35.653798 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-bd92c95f-adc7-4f01-aa95-f338c7bc6a86 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:35.654357 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-bd92c95f-adc7-4f01-aa95-f338c7bc6a86 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:35.654859 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-bd92c95f-adc7-4f01-aa95-f338c7bc6a86 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:35.655643 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-bd92c95f-adc7-4f01-aa95-f338c7bc6a86 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:35.656082 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-bd92c95f-adc7-4f01-aa95-f338c7bc6a86 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:35.656545 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-bd92c95f-adc7-4f01-aa95-f338c7bc6a86 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:35.805189 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-bd92c95f-adc7-4f01-aa95-f338c7bc6a86 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:35.817826 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-bd92c95f-adc7-4f01-aa95-f338c7bc6a86 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1359 microversion: 2.1 time: 0.171625 Aug 09 18:56:35.817826 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 441/915] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:35 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:56:36.617384 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-dfc8c1ae-ef0c-43b7-ac1d-7297dfb08c61 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:36.621199 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-dfc8c1ae-ef0c-43b7-ac1d-7297dfb08c61 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:36.625460 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dfc8c1ae-ef0c-43b7-ac1d-7297dfb08c61 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:36.626025 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dfc8c1ae-ef0c-43b7-ac1d-7297dfb08c61 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:36.626446 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dfc8c1ae-ef0c-43b7-ac1d-7297dfb08c61 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:36.627308 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dfc8c1ae-ef0c-43b7-ac1d-7297dfb08c61 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:36.627774 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dfc8c1ae-ef0c-43b7-ac1d-7297dfb08c61 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:36.628177 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dfc8c1ae-ef0c-43b7-ac1d-7297dfb08c61 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:36.717084 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-5b513fa6-1e5a-4ab2-a03e-5fd3443e159d req-394fe5bd-d8f2-4099-8de5-3cdd00a4227a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62994491-4240-4199-9ae0-b9ac533e3212", "name": "network-vif-plugged", "status": "completed", "tag": "d042031b-a302-4388-99a8-e8c5cc484000"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:56:36.728151 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-5b513fa6-1e5a-4ab2-a03e-5fd3443e159d req-394fe5bd-d8f2-4099-8de5-3cdd00a4227a service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:36.728623 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-5b513fa6-1e5a-4ab2-a03e-5fd3443e159d req-394fe5bd-d8f2-4099-8de5-3cdd00a4227a service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:36.729041 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-5b513fa6-1e5a-4ab2-a03e-5fd3443e159d req-394fe5bd-d8f2-4099-8de5-3cdd00a4227a service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:36.740898 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-5b513fa6-1e5a-4ab2-a03e-5fd3443e159d req-394fe5bd-d8f2-4099-8de5-3cdd00a4227a service nova] Creating event network-vif-plugged:d042031b-a302-4388-99a8-e8c5cc484000 for instance 62994491-4240-4199-9ae0-b9ac533e3212 on hv-cinder-82660 Aug 09 18:56:36.745869 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-5b513fa6-1e5a-4ab2-a03e-5fd3443e159d req-394fe5bd-d8f2-4099-8de5-3cdd00a4227a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032954 Aug 09 18:56:36.746454 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 442/916] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:56:36.778564 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-dfc8c1ae-ef0c-43b7-ac1d-7297dfb08c61 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:36.788568 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-dfc8c1ae-ef0c-43b7-ac1d-7297dfb08c61 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37" status: 200 len: 1318 microversion: 2.1 time: 0.175081 Aug 09 18:56:36.789172 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 475/917] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:36 2022] GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:56:36.837042 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-413e1f73-b47d-4d6f-9d4c-2f99c3f983de tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:36.837922 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-413e1f73-b47d-4d6f-9d4c-2f99c3f983de tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:36.845367 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-413e1f73-b47d-4d6f-9d4c-2f99c3f983de tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:36.846171 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-413e1f73-b47d-4d6f-9d4c-2f99c3f983de tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:36.849168 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-413e1f73-b47d-4d6f-9d4c-2f99c3f983de tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:36.849168 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-413e1f73-b47d-4d6f-9d4c-2f99c3f983de tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:36.849168 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-413e1f73-b47d-4d6f-9d4c-2f99c3f983de tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:36.849168 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-413e1f73-b47d-4d6f-9d4c-2f99c3f983de tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:37.106629 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-413e1f73-b47d-4d6f-9d4c-2f99c3f983de tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:37.116743 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-413e1f73-b47d-4d6f-9d4c-2f99c3f983de tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1359 microversion: 2.1 time: 0.283991 Aug 09 18:56:37.117781 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 443/918] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:36 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1359 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:56:37.811254 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-8c04bb67-a69d-45d8-9c68-704fcea4fd36 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:37.812616 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-8c04bb67-a69d-45d8-9c68-704fcea4fd36 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:37.819314 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8c04bb67-a69d-45d8-9c68-704fcea4fd36 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:37.819800 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8c04bb67-a69d-45d8-9c68-704fcea4fd36 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:37.820234 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8c04bb67-a69d-45d8-9c68-704fcea4fd36 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:37.820932 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8c04bb67-a69d-45d8-9c68-704fcea4fd36 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:37.821417 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8c04bb67-a69d-45d8-9c68-704fcea4fd36 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:37.821866 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8c04bb67-a69d-45d8-9c68-704fcea4fd36 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:37.961888 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-8c04bb67-a69d-45d8-9c68-704fcea4fd36 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:37.969712 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-8c04bb67-a69d-45d8-9c68-704fcea4fd36 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37" status: 200 len: 1318 microversion: 2.1 time: 0.164958 Aug 09 18:56:37.971151 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 476/919] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:37 2022] GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:56:38.138040 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-e413aa2a-e936-48b1-838f-023247b6ddcf tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:38.138762 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-e413aa2a-e936-48b1-838f-023247b6ddcf tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:38.149495 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e413aa2a-e936-48b1-838f-023247b6ddcf tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:38.150433 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e413aa2a-e936-48b1-838f-023247b6ddcf tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:38.151034 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e413aa2a-e936-48b1-838f-023247b6ddcf tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:38.151917 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e413aa2a-e936-48b1-838f-023247b6ddcf tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:38.152530 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e413aa2a-e936-48b1-838f-023247b6ddcf tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:38.153142 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e413aa2a-e936-48b1-838f-023247b6ddcf tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:38.292016 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-e413aa2a-e936-48b1-838f-023247b6ddcf tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:38.300169 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-e413aa2a-e936-48b1-838f-023247b6ddcf tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1359 microversion: 2.1 time: 0.165993 Aug 09 18:56:38.300892 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 444/920] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:38 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:56:38.768388 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-3e05b565-45d1-4592-a431-7182a80a814c req-79634825-6153-46a1-a0d8-4ecb25d20108 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9eb9fbf1-ba64-43ee-ab55-edb2768a4b37", "name": "network-vif-plugged", "status": "completed", "tag": "230a82b6-3ab2-44cc-98a7-09411b537bb9"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:56:38.778557 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-3e05b565-45d1-4592-a431-7182a80a814c req-79634825-6153-46a1-a0d8-4ecb25d20108 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:38.779040 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-3e05b565-45d1-4592-a431-7182a80a814c req-79634825-6153-46a1-a0d8-4ecb25d20108 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:38.779474 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-3e05b565-45d1-4592-a431-7182a80a814c req-79634825-6153-46a1-a0d8-4ecb25d20108 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:38.790550 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-3e05b565-45d1-4592-a431-7182a80a814c req-79634825-6153-46a1-a0d8-4ecb25d20108 service nova] Creating event network-vif-plugged:230a82b6-3ab2-44cc-98a7-09411b537bb9 for instance 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37 on hv-cinder-82660 Aug 09 18:56:38.795463 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-3e05b565-45d1-4592-a431-7182a80a814c req-79634825-6153-46a1-a0d8-4ecb25d20108 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031612 Aug 09 18:56:38.796216 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 477/921] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:56:38.991823 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-0f1713b3-c88c-4884-8e83-0f56798db55e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:38.992458 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-0f1713b3-c88c-4884-8e83-0f56798db55e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:39.002638 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0f1713b3-c88c-4884-8e83-0f56798db55e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:39.003726 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0f1713b3-c88c-4884-8e83-0f56798db55e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:39.004440 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0f1713b3-c88c-4884-8e83-0f56798db55e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:39.006024 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0f1713b3-c88c-4884-8e83-0f56798db55e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:39.006844 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0f1713b3-c88c-4884-8e83-0f56798db55e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:39.007549 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0f1713b3-c88c-4884-8e83-0f56798db55e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:39.220181 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-0f1713b3-c88c-4884-8e83-0f56798db55e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:39.228567 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-0f1713b3-c88c-4884-8e83-0f56798db55e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37" status: 200 len: 1318 microversion: 2.1 time: 0.241178 Aug 09 18:56:39.229169 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 445/922] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:38 2022] GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:56:39.321896 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b0cafad7-0363-4652-a613-26c0142d002c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:39.322624 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-b0cafad7-0363-4652-a613-26c0142d002c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:39.328669 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b0cafad7-0363-4652-a613-26c0142d002c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:39.329148 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b0cafad7-0363-4652-a613-26c0142d002c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:39.329606 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b0cafad7-0363-4652-a613-26c0142d002c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:39.330633 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b0cafad7-0363-4652-a613-26c0142d002c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:39.331091 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b0cafad7-0363-4652-a613-26c0142d002c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:39.331518 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b0cafad7-0363-4652-a613-26c0142d002c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:39.532832 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-b0cafad7-0363-4652-a613-26c0142d002c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:39.540974 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-b0cafad7-0363-4652-a613-26c0142d002c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1549 microversion: 2.1 time: 0.223848 Aug 09 18:56:39.541817 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 478/923] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:39 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1549 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:56:39.563078 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-6d98944c-600d-4697-a907-74e9edab9083 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:39.563692 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-6d98944c-600d-4697-a907-74e9edab9083 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:39.569781 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6d98944c-600d-4697-a907-74e9edab9083 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:39.570478 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6d98944c-600d-4697-a907-74e9edab9083 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:39.570962 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6d98944c-600d-4697-a907-74e9edab9083 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:39.571658 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6d98944c-600d-4697-a907-74e9edab9083 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:39.572117 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6d98944c-600d-4697-a907-74e9edab9083 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:39.572547 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6d98944c-600d-4697-a907-74e9edab9083 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:39.703331 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-6d98944c-600d-4697-a907-74e9edab9083 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:39.711632 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-6d98944c-600d-4697-a907-74e9edab9083 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1549 microversion: 2.1 time: 0.152888 Aug 09 18:56:39.712212 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 446/924] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:39 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:56:39.732129 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-8581e09e-bec5-4047-8bf6-3a12035c489d tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:39.736983 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-8581e09e-bec5-4047-8bf6-3a12035c489d tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:39.737855 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-8581e09e-bec5-4047-8bf6-3a12035c489d tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Searching by: {'deleted': False, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8'} {{(pid=124725) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 18:56:39.744325 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8581e09e-bec5-4047-8bf6-3a12035c489d tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:39.747001 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8581e09e-bec5-4047-8bf6-3a12035c489d tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:39.747001 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8581e09e-bec5-4047-8bf6-3a12035c489d tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:39.747001 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8581e09e-bec5-4047-8bf6-3a12035c489d tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:39.747001 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8581e09e-bec5-4047-8bf6-3a12035c489d tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:39.747393 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8581e09e-bec5-4047-8bf6-3a12035c489d tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:39.838906 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.multi_cell_list [None req-8581e09e-bec5-4047-8bf6-3a12035c489d tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124725) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 18:56:40.085140 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-8581e09e-bec5-4047-8bf6-3a12035c489d tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.356860 Aug 09 18:56:40.090977 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 479/925] 10.222.0.57 () {58 vars in 1125 bytes} [Tue Aug 9 18:56:39 2022] GET /compute/v2.1/servers => generated 343 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:56:40.100489 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-6b4bc59b-79ba-4c0f-8f9a-a9563d207a98 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:40.101434 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-6b4bc59b-79ba-4c0f-8f9a-a9563d207a98 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:40.111567 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6b4bc59b-79ba-4c0f-8f9a-a9563d207a98 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:40.112289 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6b4bc59b-79ba-4c0f-8f9a-a9563d207a98 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:40.112732 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6b4bc59b-79ba-4c0f-8f9a-a9563d207a98 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:40.113452 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6b4bc59b-79ba-4c0f-8f9a-a9563d207a98 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:40.115847 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6b4bc59b-79ba-4c0f-8f9a-a9563d207a98 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:40.117079 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6b4bc59b-79ba-4c0f-8f9a-a9563d207a98 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:40.126936 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell1:SELECT=100 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:56:40.251973 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-fe73fd18-0d90-4d94-986c-39e0d98fe034 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:40.252582 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-fe73fd18-0d90-4d94-986c-39e0d98fe034 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:40.259179 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fe73fd18-0d90-4d94-986c-39e0d98fe034 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:40.259660 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fe73fd18-0d90-4d94-986c-39e0d98fe034 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:40.260098 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fe73fd18-0d90-4d94-986c-39e0d98fe034 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:40.260801 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fe73fd18-0d90-4d94-986c-39e0d98fe034 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:40.261264 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fe73fd18-0d90-4d94-986c-39e0d98fe034 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:40.261719 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fe73fd18-0d90-4d94-986c-39e0d98fe034 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:40.346726 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-6b4bc59b-79ba-4c0f-8f9a-a9563d207a98 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:40.351980 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-6b4bc59b-79ba-4c0f-8f9a-a9563d207a98 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1549 microversion: 2.1 time: 0.255275 Aug 09 18:56:40.352628 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 447/926] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:40 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1549 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:56:40.413257 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-fe73fd18-0d90-4d94-986c-39e0d98fe034 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:40.430179 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-fe73fd18-0d90-4d94-986c-39e0d98fe034 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37" status: 200 len: 1318 microversion: 2.1 time: 0.181339 Aug 09 18:56:40.431217 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 480/927] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:40 2022] GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:56:41.452287 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-904a020f-f5e7-401d-825a-7e85eba5649c tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:41.452921 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-904a020f-f5e7-401d-825a-7e85eba5649c tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:41.457050 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:56:41.460429 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-904a020f-f5e7-401d-825a-7e85eba5649c tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:41.463717 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-904a020f-f5e7-401d-825a-7e85eba5649c tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:41.463717 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-904a020f-f5e7-401d-825a-7e85eba5649c tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:41.463717 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-904a020f-f5e7-401d-825a-7e85eba5649c tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:41.463717 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-904a020f-f5e7-401d-825a-7e85eba5649c tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:41.464232 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-904a020f-f5e7-401d-825a-7e85eba5649c tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:41.615687 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-904a020f-f5e7-401d-825a-7e85eba5649c tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:41.623464 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-904a020f-f5e7-401d-825a-7e85eba5649c tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37" status: 200 len: 1507 microversion: 2.1 time: 0.175070 Aug 09 18:56:41.633703 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 448/928] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:41 2022] GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37 => generated 1507 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:56:42.525019 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-60f85d15-6fd0-466f-a282-a2233aac34e3 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0927febe-585d-4aea-814d-a33270d9dee3"}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:56:42.529491 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-60f85d15-6fd0-466f-a282-a2233aac34e3 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:42.533266 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:56:42.535249 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-60f85d15-6fd0-466f-a282-a2233aac34e3 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:42.535737 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-60f85d15-6fd0-466f-a282-a2233aac34e3 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:42.536146 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-60f85d15-6fd0-466f-a282-a2233aac34e3 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:42.536856 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-60f85d15-6fd0-466f-a282-a2233aac34e3 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:42.537304 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-60f85d15-6fd0-466f-a282-a2233aac34e3 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:42.537760 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-60f85d15-6fd0-466f-a282-a2233aac34e3 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:42.616812 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=100 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:56:43.258685 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-60f85d15-6fd0-466f-a282-a2233aac34e3 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "POST /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.737315 Aug 09 18:56:43.259245 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 481/929] 10.222.0.57 () {60 vars in 1323 bytes} [Tue Aug 9 18:56:42 2022] POST /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212/os-volume_attachments => generated 194 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:56:50.883290 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-d489d280-b524-4bd0-893c-6b1b2598b6d5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:50.883922 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-d489d280-b524-4bd0-893c-6b1b2598b6d5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:50.890623 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d489d280-b524-4bd0-893c-6b1b2598b6d5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:50.891107 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d489d280-b524-4bd0-893c-6b1b2598b6d5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:50.891533 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d489d280-b524-4bd0-893c-6b1b2598b6d5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:50.892227 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d489d280-b524-4bd0-893c-6b1b2598b6d5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:50.892675 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d489d280-b524-4bd0-893c-6b1b2598b6d5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:50.893100 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d489d280-b524-4bd0-893c-6b1b2598b6d5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:51.038815 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-d489d280-b524-4bd0-893c-6b1b2598b6d5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:51.049698 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-d489d280-b524-4bd0-893c-6b1b2598b6d5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1595 microversion: 2.1 time: 0.170339 Aug 09 18:56:51.050571 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 449/930] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:50 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1595 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:56:53.432056 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=2 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:56:53.433079 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=6,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:56:53.441189 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-1c4bf06d-fd8d-4e48-a370-9140bca95b81 req-32996c73-f601-440e-b703-2b0021fd182f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62994491-4240-4199-9ae0-b9ac533e3212", "tag": "d042031b-a302-4388-99a8-e8c5cc484000"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:56:53.458739 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-1c4bf06d-fd8d-4e48-a370-9140bca95b81 req-32996c73-f601-440e-b703-2b0021fd182f service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:53.459992 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-1c4bf06d-fd8d-4e48-a370-9140bca95b81 req-32996c73-f601-440e-b703-2b0021fd182f service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:53.460506 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-1c4bf06d-fd8d-4e48-a370-9140bca95b81 req-32996c73-f601-440e-b703-2b0021fd182f service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:53.473924 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-1c4bf06d-fd8d-4e48-a370-9140bca95b81 req-32996c73-f601-440e-b703-2b0021fd182f service nova] Creating event network-changed:d042031b-a302-4388-99a8-e8c5cc484000 for instance 62994491-4240-4199-9ae0-b9ac533e3212 on hv-cinder-82660 Aug 09 18:56:53.479478 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-1c4bf06d-fd8d-4e48-a370-9140bca95b81 req-32996c73-f601-440e-b703-2b0021fd182f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048822 Aug 09 18:56:53.480087 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 482/931] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:56:55.991054 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-08892e72-b715-4751-88c3-4462fea8d7ae tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-210458069"}} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:56:55.991673 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-08892e72-b715-4751-88c3-4462fea8d7ae tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:55.998767 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-08892e72-b715-4751-88c3-4462fea8d7ae tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:56.000214 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-08892e72-b715-4751-88c3-4462fea8d7ae tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:56.000591 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-08892e72-b715-4751-88c3-4462fea8d7ae tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:56.001305 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-08892e72-b715-4751-88c3-4462fea8d7ae tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:56.001792 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-08892e72-b715-4751-88c3-4462fea8d7ae tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:56.002252 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-08892e72-b715-4751-88c3-4462fea8d7ae tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:56.251958 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.network.security_group_api [None req-08892e72-b715-4751-88c3-4462fea8d7ae tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Adding security group cccda923-aee6-46dd-8718-709930853f4f to port d042031b-a302-4388-99a8-e8c5cc484000 Aug 09 18:56:56.698507 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-08892e72-b715-4751-88c3-4462fea8d7ae tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "POST /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212/action" status: 202 len: 0 microversion: 2.1 time: 0.711483 Aug 09 18:56:56.699790 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 450/932] 10.222.0.57 () {60 vars in 1278 bytes} [Tue Aug 9 18:56:55 2022] POST /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212/action => generated 0 bytes in 714 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:56:56.710336 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-af3178b2-ae1d-4a9f-b23f-488d6c57977d tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:56:56.711699 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-af3178b2-ae1d-4a9f-b23f-488d6c57977d tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:56:56.730173 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-3ca21380-1a1c-4d01-9c71-28964b7512c1 req-8a24e0bd-2d19-4177-ad4a-4e6294aed4a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62994491-4240-4199-9ae0-b9ac533e3212", "tag": "d042031b-a302-4388-99a8-e8c5cc484000"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:56:56.733085 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-af3178b2-ae1d-4a9f-b23f-488d6c57977d tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:56.735144 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-af3178b2-ae1d-4a9f-b23f-488d6c57977d tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:56.735607 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-af3178b2-ae1d-4a9f-b23f-488d6c57977d tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:56.736336 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-af3178b2-ae1d-4a9f-b23f-488d6c57977d tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:56.741794 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-3ca21380-1a1c-4d01-9c71-28964b7512c1 req-8a24e0bd-2d19-4177-ad4a-4e6294aed4a9 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:56:56.742550 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-3ca21380-1a1c-4d01-9c71-28964b7512c1 req-8a24e0bd-2d19-4177-ad4a-4e6294aed4a9 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:56.743134 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-3ca21380-1a1c-4d01-9c71-28964b7512c1 req-8a24e0bd-2d19-4177-ad4a-4e6294aed4a9 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:56.745413 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-af3178b2-ae1d-4a9f-b23f-488d6c57977d tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:56:56.746043 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-af3178b2-ae1d-4a9f-b23f-488d6c57977d tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:56:56.757730 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-3ca21380-1a1c-4d01-9c71-28964b7512c1 req-8a24e0bd-2d19-4177-ad4a-4e6294aed4a9 service nova] Creating event network-changed:d042031b-a302-4388-99a8-e8c5cc484000 for instance 62994491-4240-4199-9ae0-b9ac533e3212 on hv-cinder-82660 Aug 09 18:56:56.764837 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-3ca21380-1a1c-4d01-9c71-28964b7512c1 req-8a24e0bd-2d19-4177-ad4a-4e6294aed4a9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039066 Aug 09 18:56:56.768299 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 451/933] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:56:56.899485 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-af3178b2-ae1d-4a9f-b23f-488d6c57977d tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:56:56.908530 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-af3178b2-ae1d-4a9f-b23f-488d6c57977d tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1641 microversion: 2.1 time: 0.204089 Aug 09 18:56:56.909115 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 483/934] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:56:56 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1641 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:57:04.242555 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-1a77190a-3c6b-471c-adf6-730698f4f53e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9585b5c-8853-4460-a2bf-a635fd62cb1b", "device": "/dev/sdb"}} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:57:04.245463 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-1a77190a-3c6b-471c-adf6-730698f4f53e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:04.251755 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1a77190a-3c6b-471c-adf6-730698f4f53e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:04.252230 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1a77190a-3c6b-471c-adf6-730698f4f53e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:04.252653 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1a77190a-3c6b-471c-adf6-730698f4f53e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:04.253342 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1a77190a-3c6b-471c-adf6-730698f4f53e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:04.253816 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1a77190a-3c6b-471c-adf6-730698f4f53e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:04.254236 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1a77190a-3c6b-471c-adf6-730698f4f53e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:05.005802 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-1a77190a-3c6b-471c-adf6-730698f4f53e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "POST /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.768302 Aug 09 18:57:05.007354 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 452/935] 10.222.0.57 () {60 vars in 1323 bytes} [Tue Aug 9 18:57:04 2022] POST /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37/os-volume_attachments => generated 194 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:57:26.353769 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-30f8936b-93b9-4d45-8927-288e82086bd8 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-157044634", "imageRef": "124dd477-ccfa-4be3-9973-6b1f33b47df8", "flavorRef": "452", "networks": [{"uuid": "6867efd8-34f8-4d8b-8081-9f5fd287cb5a"}]}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:57:26.371388 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=5 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:57:26.372310 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=8 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:57:26.422785 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.network.neutron [None req-30f8936b-93b9-4d45-8927-288e82086bd8 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] validate_networks() for [('6867efd8-34f8-4d8b-8081-9f5fd287cb5a', None, None, None, None, None)] {{(pid=124725) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:57:26.834835 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-30f8936b-93b9-4d45-8927-288e82086bd8 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Flavor limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:57:26.835301 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-30f8936b-93b9-4d45-8927-288e82086bd8 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Image limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:57:26.835816 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-30f8936b-93b9-4d45-8927-288e82086bd8 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Flavor pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:57:26.836300 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-30f8936b-93b9-4d45-8927-288e82086bd8 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Image pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:57:26.836722 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-30f8936b-93b9-4d45-8927-288e82086bd8 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:57:26.847272 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-30f8936b-93b9-4d45-8927-288e82086bd8 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:26.847677 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-30f8936b-93b9-4d45-8927-288e82086bd8 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:26.848116 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-30f8936b-93b9-4d45-8927-288e82086bd8 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:26.848847 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-30f8936b-93b9-4d45-8927-288e82086bd8 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:26.849304 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-30f8936b-93b9-4d45-8927-288e82086bd8 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:26.849761 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-30f8936b-93b9-4d45-8927-288e82086bd8 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:26.867986 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-30f8936b-93b9-4d45-8927-288e82086bd8 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Getting quotas for project 8b6338088b03415aa67ca34647ca0700. Resources: {'cores', 'ram', 'instances'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:57:26.873173 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-30f8936b-93b9-4d45-8927-288e82086bd8 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Getting quotas for user debdf689e44c48e1bca1c7ad37f8335f and project 8b6338088b03415aa67ca34647ca0700. Resources: {'cores', 'ram', 'instances'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:57:26.885141 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-30f8936b-93b9-4d45-8927-288e82086bd8 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Going to run 1 instances... {{(pid=124725) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:57:26.887461 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-30f8936b-93b9-4d45-8927-288e82086bd8 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: 87fa2c0c-b36e-4990-bda7-bab94f06ca6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='124dd477-ccfa-4be3-9973-6b1f33b47df8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:57:27.020873 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-30f8936b-93b9-4d45-8927-288e82086bd8 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.671161 Aug 09 18:57:27.021908 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 484/936] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 9 18:57:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:57:27.030303 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_api:SELECT=8 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:57:27.031460 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:57:27.036046 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-2dc4ce54-0253-4da3-8fee-b85f3017f606 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:27.036836 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-2dc4ce54-0253-4da3-8fee-b85f3017f606 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: 87fa2c0c-b36e-4990-bda7-bab94f06ca6a] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:27.100793 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-2dc4ce54-0253-4da3-8fee-b85f3017f606 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'debdf689e44c48e1bca1c7ad37f8335f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6338088b03415aa67ca34647ca0700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:27.102974 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-2dc4ce54-0253-4da3-8fee-b85f3017f606 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] 10.222.0.57 "GET /compute/v2.1/servers/87fa2c0c-b36e-4990-bda7-bab94f06ca6a" status: 200 len: 1213 microversion: 2.1 time: 0.074261 Aug 09 18:57:27.103543 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 453/937] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:27 2022] GET /compute/v2.1/servers/87fa2c0c-b36e-4990-bda7-bab94f06ca6a => generated 1213 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:57:28.125156 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-7bc914f7-0567-4028-8cce-735c7f83fdc7 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:28.125726 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-7bc914f7-0567-4028-8cce-735c7f83fdc7 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: 87fa2c0c-b36e-4990-bda7-bab94f06ca6a] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:28.178106 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-7bc914f7-0567-4028-8cce-735c7f83fdc7 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'debdf689e44c48e1bca1c7ad37f8335f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6338088b03415aa67ca34647ca0700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:28.185211 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-7bc914f7-0567-4028-8cce-735c7f83fdc7 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] 10.222.0.57 "GET /compute/v2.1/servers/87fa2c0c-b36e-4990-bda7-bab94f06ca6a" status: 200 len: 1213 microversion: 2.1 time: 0.064561 Aug 09 18:57:28.185805 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 485/938] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:28 2022] GET /compute/v2.1/servers/87fa2c0c-b36e-4990-bda7-bab94f06ca6a => generated 1213 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:57:29.207514 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-ebc4512e-7036-4a42-8b2e-63abe955c6c2 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:29.208365 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-ebc4512e-7036-4a42-8b2e-63abe955c6c2 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: 87fa2c0c-b36e-4990-bda7-bab94f06ca6a] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:29.217344 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ebc4512e-7036-4a42-8b2e-63abe955c6c2 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:29.217975 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ebc4512e-7036-4a42-8b2e-63abe955c6c2 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:29.218416 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ebc4512e-7036-4a42-8b2e-63abe955c6c2 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:29.219116 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ebc4512e-7036-4a42-8b2e-63abe955c6c2 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:29.219566 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ebc4512e-7036-4a42-8b2e-63abe955c6c2 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:29.220012 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ebc4512e-7036-4a42-8b2e-63abe955c6c2 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:29.283015 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-ebc4512e-7036-4a42-8b2e-63abe955c6c2 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'debdf689e44c48e1bca1c7ad37f8335f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6338088b03415aa67ca34647ca0700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:29.290344 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-ebc4512e-7036-4a42-8b2e-63abe955c6c2 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] 10.222.0.57 "GET /compute/v2.1/servers/87fa2c0c-b36e-4990-bda7-bab94f06ca6a" status: 200 len: 1265 microversion: 2.1 time: 0.087286 Aug 09 18:57:29.291038 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 454/939] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:29 2022] GET /compute/v2.1/servers/87fa2c0c-b36e-4990-bda7-bab94f06ca6a => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:57:29.877502 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-91acbb6d-44ae-4a07-a495-44ef8018edab tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:29.878271 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-91acbb6d-44ae-4a07-a495-44ef8018edab tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:29.885700 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-91acbb6d-44ae-4a07-a495-44ef8018edab tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:29.886311 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-91acbb6d-44ae-4a07-a495-44ef8018edab tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:29.886832 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-91acbb6d-44ae-4a07-a495-44ef8018edab tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:29.887749 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-91acbb6d-44ae-4a07-a495-44ef8018edab tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:29.888363 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-91acbb6d-44ae-4a07-a495-44ef8018edab tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:29.888780 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-91acbb6d-44ae-4a07-a495-44ef8018edab tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:29.976020 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.objects.instance [None req-91acbb6d-44ae-4a07-a495-44ef8018edab tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lazy-loading 'services' on Instance uuid 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37 {{(pid=124725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:57:30.224809 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-91acbb6d-44ae-4a07-a495-44ef8018edab tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "DELETE /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37/os-volume_attachments/c9585b5c-8853-4460-a2bf-a635fd62cb1b" status: 202 len: 0 microversion: 2.1 time: 0.351160 Aug 09 18:57:30.225803 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 486/940] 10.222.0.57 () {58 vars in 1416 bytes} [Tue Aug 9 18:57:29 2022] DELETE /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37/os-volume_attachments/c9585b5c-8853-4460-a2bf-a635fd62cb1b => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:57:30.318039 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-ee4558b2-f24f-46be-b2d4-c61dfe95b3de tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:30.318826 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-ee4558b2-f24f-46be-b2d4-c61dfe95b3de tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: 87fa2c0c-b36e-4990-bda7-bab94f06ca6a] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:30.326042 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ee4558b2-f24f-46be-b2d4-c61dfe95b3de tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:30.326634 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ee4558b2-f24f-46be-b2d4-c61dfe95b3de tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:30.327381 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ee4558b2-f24f-46be-b2d4-c61dfe95b3de tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:30.328312 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ee4558b2-f24f-46be-b2d4-c61dfe95b3de tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:30.328917 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ee4558b2-f24f-46be-b2d4-c61dfe95b3de tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:30.329501 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ee4558b2-f24f-46be-b2d4-c61dfe95b3de tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:30.418184 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-ee4558b2-f24f-46be-b2d4-c61dfe95b3de tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'debdf689e44c48e1bca1c7ad37f8335f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6338088b03415aa67ca34647ca0700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:30.427488 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-ee4558b2-f24f-46be-b2d4-c61dfe95b3de tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] 10.222.0.57 "GET /compute/v2.1/servers/87fa2c0c-b36e-4990-bda7-bab94f06ca6a" status: 200 len: 1271 microversion: 2.1 time: 0.113187 Aug 09 18:57:30.428091 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 455/941] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:30 2022] GET /compute/v2.1/servers/87fa2c0c-b36e-4990-bda7-bab94f06ca6a => generated 1271 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:57:31.393824 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e879a807-bd0a-45ab-9587-30634923af43 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:31.394507 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e879a807-bd0a-45ab-9587-30634923af43 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:31.401697 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e879a807-bd0a-45ab-9587-30634923af43 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:31.402184 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e879a807-bd0a-45ab-9587-30634923af43 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:31.402621 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e879a807-bd0a-45ab-9587-30634923af43 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:31.403324 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e879a807-bd0a-45ab-9587-30634923af43 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:31.403780 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e879a807-bd0a-45ab-9587-30634923af43 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:31.404206 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e879a807-bd0a-45ab-9587-30634923af43 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:31.430949 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e879a807-bd0a-45ab-9587-30634923af43 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37] Going to try to terminate instance {{(pid=124725) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:57:31.450570 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-5bb45b4f-6699-45c9-9623-0fc1311b4174 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:31.451327 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-5bb45b4f-6699-45c9-9623-0fc1311b4174 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: 87fa2c0c-b36e-4990-bda7-bab94f06ca6a] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:31.458455 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5bb45b4f-6699-45c9-9623-0fc1311b4174 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:31.463958 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5bb45b4f-6699-45c9-9623-0fc1311b4174 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:31.463958 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5bb45b4f-6699-45c9-9623-0fc1311b4174 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:31.463958 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5bb45b4f-6699-45c9-9623-0fc1311b4174 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:31.463958 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5bb45b4f-6699-45c9-9623-0fc1311b4174 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:31.464926 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5bb45b4f-6699-45c9-9623-0fc1311b4174 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:31.701302 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-5bb45b4f-6699-45c9-9623-0fc1311b4174 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'debdf689e44c48e1bca1c7ad37f8335f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6338088b03415aa67ca34647ca0700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:31.708934 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-5bb45b4f-6699-45c9-9623-0fc1311b4174 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] 10.222.0.57 "GET /compute/v2.1/servers/87fa2c0c-b36e-4990-bda7-bab94f06ca6a" status: 200 len: 1313 microversion: 2.1 time: 0.262420 Aug 09 18:57:31.710221 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 456/942] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:31 2022] GET /compute/v2.1/servers/87fa2c0c-b36e-4990-bda7-bab94f06ca6a => generated 1313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:57:31.711876 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e879a807-bd0a-45ab-9587-30634923af43 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "DELETE /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37" status: 204 len: 0 microversion: 2.1 time: 0.321812 Aug 09 18:57:31.712465 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 487/943] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 9 18:57:31 2022] DELETE /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:57:31.714549 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-fc9b312f-1bea-4953-88f7-2a349104a538 req-c04a1a58-bcd8-4f15-b920-fd5caa1cae88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87fa2c0c-b36e-4990-bda7-bab94f06ca6a", "tag": "8a1e776e-6f69-48e9-9708-1beda97d8a58"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:57:31.727145 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-fc9b312f-1bea-4953-88f7-2a349104a538 req-c04a1a58-bcd8-4f15-b920-fd5caa1cae88 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:31.727145 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-fc9b312f-1bea-4953-88f7-2a349104a538 req-c04a1a58-bcd8-4f15-b920-fd5caa1cae88 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:31.727145 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-fc9b312f-1bea-4953-88f7-2a349104a538 req-c04a1a58-bcd8-4f15-b920-fd5caa1cae88 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:31.733448 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-41aa5683-dbda-49bb-86d4-3c5bc9744b09 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:31.734178 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-41aa5683-dbda-49bb-86d4-3c5bc9744b09 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:31.739045 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-fc9b312f-1bea-4953-88f7-2a349104a538 req-c04a1a58-bcd8-4f15-b920-fd5caa1cae88 service nova] Creating event network-changed:8a1e776e-6f69-48e9-9708-1beda97d8a58 for instance 87fa2c0c-b36e-4990-bda7-bab94f06ca6a on hv-cinder-82660 Aug 09 18:57:31.740840 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-41aa5683-dbda-49bb-86d4-3c5bc9744b09 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:31.741564 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-41aa5683-dbda-49bb-86d4-3c5bc9744b09 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:31.743553 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-41aa5683-dbda-49bb-86d4-3c5bc9744b09 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:31.743553 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-41aa5683-dbda-49bb-86d4-3c5bc9744b09 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:31.743553 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-41aa5683-dbda-49bb-86d4-3c5bc9744b09 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:31.743553 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-41aa5683-dbda-49bb-86d4-3c5bc9744b09 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:31.744040 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-fc9b312f-1bea-4953-88f7-2a349104a538 req-c04a1a58-bcd8-4f15-b920-fd5caa1cae88 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033411 Aug 09 18:57:31.744813 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 457/944] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:57:31.898582 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-41aa5683-dbda-49bb-86d4-3c5bc9744b09 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:31.907218 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-41aa5683-dbda-49bb-86d4-3c5bc9744b09 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37" status: 200 len: 1513 microversion: 2.1 time: 0.177971 Aug 09 18:57:31.907928 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 488/945] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:31 2022] GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37 => generated 1513 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:57:32.737795 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-7c32c495-3664-4c5e-847e-cf528dca283e tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:32.738406 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-7c32c495-3664-4c5e-847e-cf528dca283e tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: 87fa2c0c-b36e-4990-bda7-bab94f06ca6a] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:32.744647 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7c32c495-3664-4c5e-847e-cf528dca283e tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:32.746702 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7c32c495-3664-4c5e-847e-cf528dca283e tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:32.746702 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7c32c495-3664-4c5e-847e-cf528dca283e tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:32.746702 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7c32c495-3664-4c5e-847e-cf528dca283e tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:32.746702 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7c32c495-3664-4c5e-847e-cf528dca283e tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:32.747072 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7c32c495-3664-4c5e-847e-cf528dca283e tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:32.881476 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-7c32c495-3664-4c5e-847e-cf528dca283e tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'debdf689e44c48e1bca1c7ad37f8335f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6338088b03415aa67ca34647ca0700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:32.889067 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-7c32c495-3664-4c5e-847e-cf528dca283e tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] 10.222.0.57 "GET /compute/v2.1/servers/87fa2c0c-b36e-4990-bda7-bab94f06ca6a" status: 200 len: 1313 microversion: 2.1 time: 0.155999 Aug 09 18:57:32.889659 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 458/946] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:32 2022] GET /compute/v2.1/servers/87fa2c0c-b36e-4990-bda7-bab94f06ca6a => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:57:32.937733 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-bf9463d2-3b3e-417b-9496-8144edf535d7 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:32.938343 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-bf9463d2-3b3e-417b-9496-8144edf535d7 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:32.944630 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bf9463d2-3b3e-417b-9496-8144edf535d7 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:32.945100 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bf9463d2-3b3e-417b-9496-8144edf535d7 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:32.946061 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bf9463d2-3b3e-417b-9496-8144edf535d7 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:32.946746 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bf9463d2-3b3e-417b-9496-8144edf535d7 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:32.947197 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bf9463d2-3b3e-417b-9496-8144edf535d7 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:32.947622 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bf9463d2-3b3e-417b-9496-8144edf535d7 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:33.082542 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-bf9463d2-3b3e-417b-9496-8144edf535d7 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:33.090970 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-bf9463d2-3b3e-417b-9496-8144edf535d7 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37" status: 200 len: 1513 microversion: 2.1 time: 0.157790 Aug 09 18:57:33.091544 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 489/947] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:32 2022] GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:57:33.910356 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-c6edeeb1-ba35-47c4-97c8-df4571ac0b89 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:33.911119 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-c6edeeb1-ba35-47c4-97c8-df4571ac0b89 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: 87fa2c0c-b36e-4990-bda7-bab94f06ca6a] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:33.917495 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c6edeeb1-ba35-47c4-97c8-df4571ac0b89 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:33.918001 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c6edeeb1-ba35-47c4-97c8-df4571ac0b89 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:33.918436 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c6edeeb1-ba35-47c4-97c8-df4571ac0b89 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:33.919137 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c6edeeb1-ba35-47c4-97c8-df4571ac0b89 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:33.919586 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c6edeeb1-ba35-47c4-97c8-df4571ac0b89 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:33.920002 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c6edeeb1-ba35-47c4-97c8-df4571ac0b89 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:34.056411 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-c6edeeb1-ba35-47c4-97c8-df4571ac0b89 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'debdf689e44c48e1bca1c7ad37f8335f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6338088b03415aa67ca34647ca0700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:34.065952 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-c6edeeb1-ba35-47c4-97c8-df4571ac0b89 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] 10.222.0.57 "GET /compute/v2.1/servers/87fa2c0c-b36e-4990-bda7-bab94f06ca6a" status: 200 len: 1313 microversion: 2.1 time: 0.159369 Aug 09 18:57:34.066529 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 459/948] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:33 2022] GET /compute/v2.1/servers/87fa2c0c-b36e-4990-bda7-bab94f06ca6a => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:57:34.112192 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e9555f25-10c1-405d-9bf8-7695ba9f054a tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:34.112833 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e9555f25-10c1-405d-9bf8-7695ba9f054a tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:34.119627 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e9555f25-10c1-405d-9bf8-7695ba9f054a tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:34.120096 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e9555f25-10c1-405d-9bf8-7695ba9f054a tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:34.120524 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e9555f25-10c1-405d-9bf8-7695ba9f054a tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:34.121226 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e9555f25-10c1-405d-9bf8-7695ba9f054a tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:34.121732 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e9555f25-10c1-405d-9bf8-7695ba9f054a tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:34.122154 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e9555f25-10c1-405d-9bf8-7695ba9f054a tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:34.264117 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e9555f25-10c1-405d-9bf8-7695ba9f054a tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:34.268166 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e9555f25-10c1-405d-9bf8-7695ba9f054a tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37" status: 200 len: 1513 microversion: 2.1 time: 0.159695 Aug 09 18:57:34.279753 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 490/949] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:34 2022] GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37 => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:57:34.928930 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-2183f7b7-4af7-4033-ba00-0ba23ba5ac50 req-f14e61df-ae29-4b99-b105-05179bdaa041 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9eb9fbf1-ba64-43ee-ab55-edb2768a4b37", "name": "network-vif-deleted", "tag": "230a82b6-3ab2-44cc-98a7-09411b537bb9"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:57:34.939112 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-2183f7b7-4af7-4033-ba00-0ba23ba5ac50 req-f14e61df-ae29-4b99-b105-05179bdaa041 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:34.939588 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-2183f7b7-4af7-4033-ba00-0ba23ba5ac50 req-f14e61df-ae29-4b99-b105-05179bdaa041 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:34.941556 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-2183f7b7-4af7-4033-ba00-0ba23ba5ac50 req-f14e61df-ae29-4b99-b105-05179bdaa041 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:34.951524 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-2183f7b7-4af7-4033-ba00-0ba23ba5ac50 req-f14e61df-ae29-4b99-b105-05179bdaa041 service nova] Creating event network-vif-deleted:230a82b6-3ab2-44cc-98a7-09411b537bb9 for instance 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37 on hv-cinder-82660 Aug 09 18:57:34.956453 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-2183f7b7-4af7-4033-ba00-0ba23ba5ac50 req-f14e61df-ae29-4b99-b105-05179bdaa041 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031224 Aug 09 18:57:34.957043 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 460/950] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:57:35.087385 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f8e926af-bab8-4fc6-9f7c-07db7e09821a tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:35.088157 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-f8e926af-bab8-4fc6-9f7c-07db7e09821a tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: 87fa2c0c-b36e-4990-bda7-bab94f06ca6a] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:35.095172 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f8e926af-bab8-4fc6-9f7c-07db7e09821a tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:35.102503 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f8e926af-bab8-4fc6-9f7c-07db7e09821a tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:35.102503 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f8e926af-bab8-4fc6-9f7c-07db7e09821a tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:35.102503 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f8e926af-bab8-4fc6-9f7c-07db7e09821a tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:35.102503 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f8e926af-bab8-4fc6-9f7c-07db7e09821a tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:35.103030 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f8e926af-bab8-4fc6-9f7c-07db7e09821a tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:35.252400 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f8e926af-bab8-4fc6-9f7c-07db7e09821a tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'debdf689e44c48e1bca1c7ad37f8335f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6338088b03415aa67ca34647ca0700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:35.262130 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f8e926af-bab8-4fc6-9f7c-07db7e09821a tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] 10.222.0.57 "GET /compute/v2.1/servers/87fa2c0c-b36e-4990-bda7-bab94f06ca6a" status: 200 len: 1313 microversion: 2.1 time: 0.179019 Aug 09 18:57:35.262990 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 491/951] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:35 2022] GET /compute/v2.1/servers/87fa2c0c-b36e-4990-bda7-bab94f06ca6a => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:57:35.291277 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-167d4cf2-9e15-4124-acac-11cc06901649 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:35.292283 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-167d4cf2-9e15-4124-acac-11cc06901649 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:35.298785 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-167d4cf2-9e15-4124-acac-11cc06901649 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:35.299273 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-167d4cf2-9e15-4124-acac-11cc06901649 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:35.299707 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-167d4cf2-9e15-4124-acac-11cc06901649 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:35.300404 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-167d4cf2-9e15-4124-acac-11cc06901649 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:35.300860 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-167d4cf2-9e15-4124-acac-11cc06901649 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:35.301283 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-167d4cf2-9e15-4124-acac-11cc06901649 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:35.334959 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-167d4cf2-9e15-4124-acac-11cc06901649 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:35.335436 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-167d4cf2-9e15-4124-acac-11cc06901649 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:35.336665 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-167d4cf2-9e15-4124-acac-11cc06901649 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:35.337085 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.objects.instance [None req-167d4cf2-9e15-4124-acac-11cc06901649 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lazy-loading 'fault' on Instance uuid 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37 {{(pid=124726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:57:35.384207 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-167d4cf2-9e15-4124-acac-11cc06901649 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:35.392751 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-167d4cf2-9e15-4124-acac-11cc06901649 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37" status: 200 len: 1308 microversion: 2.1 time: 0.105845 Aug 09 18:57:35.393383 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 461/952] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:35 2022] GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37 => generated 1308 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:57:36.283741 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b354c25f-592a-432e-b243-b2778885c42a tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:36.284344 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-b354c25f-592a-432e-b243-b2778885c42a tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: 87fa2c0c-b36e-4990-bda7-bab94f06ca6a] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:36.294799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b354c25f-592a-432e-b243-b2778885c42a tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:36.294799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b354c25f-592a-432e-b243-b2778885c42a tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:36.294799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b354c25f-592a-432e-b243-b2778885c42a tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:36.294799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b354c25f-592a-432e-b243-b2778885c42a tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:36.295304 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b354c25f-592a-432e-b243-b2778885c42a tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:36.295304 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b354c25f-592a-432e-b243-b2778885c42a tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:36.382279 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-74d176a8-d42a-494a-a7c7-897bb294f002 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:57:36.385034 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-74d176a8-d42a-494a-a7c7-897bb294f002 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:36.391438 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-74d176a8-d42a-494a-a7c7-897bb294f002 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:36.391916 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-74d176a8-d42a-494a-a7c7-897bb294f002 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:36.392375 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-74d176a8-d42a-494a-a7c7-897bb294f002 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:36.393610 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-74d176a8-d42a-494a-a7c7-897bb294f002 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:36.393948 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-74d176a8-d42a-494a-a7c7-897bb294f002 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:36.394370 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-74d176a8-d42a-494a-a7c7-897bb294f002 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:36.426888 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-b354c25f-592a-432e-b243-b2778885c42a tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'debdf689e44c48e1bca1c7ad37f8335f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6338088b03415aa67ca34647ca0700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:36.437946 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-b354c25f-592a-432e-b243-b2778885c42a tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] 10.222.0.57 "GET /compute/v2.1/servers/87fa2c0c-b36e-4990-bda7-bab94f06ca6a" status: 200 len: 1313 microversion: 2.1 time: 0.157678 Aug 09 18:57:36.438734 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 492/953] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:36 2022] GET /compute/v2.1/servers/87fa2c0c-b36e-4990-bda7-bab94f06ca6a => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:57:36.443548 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a9f5892a-223f-4946-aa30-13fd44cc1b1d tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:36.445383 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-a9f5892a-223f-4946-aa30-13fd44cc1b1d tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:36.451156 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a9f5892a-223f-4946-aa30-13fd44cc1b1d tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:36.451637 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a9f5892a-223f-4946-aa30-13fd44cc1b1d tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:36.452064 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a9f5892a-223f-4946-aa30-13fd44cc1b1d tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:36.452758 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a9f5892a-223f-4946-aa30-13fd44cc1b1d tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:36.453199 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a9f5892a-223f-4946-aa30-13fd44cc1b1d tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:36.453847 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a9f5892a-223f-4946-aa30-13fd44cc1b1d tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:36.469222 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-a9f5892a-223f-4946-aa30-13fd44cc1b1d tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] HTTP exception thrown: Instance 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37 could not be found. Aug 09 18:57:36.470998 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a9f5892a-223f-4946-aa30-13fd44cc1b1d tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Request method failure captured: Aug 09 18:57:36.470998 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: request: GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37 HTTP/1.1 Aug 09 18:57:36.470998 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept: application/json Aug 09 18:57:36.470998 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Aug 09 18:57:36.470998 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Connection: close Aug 09 18:57:36.470998 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Length: 0 Aug 09 18:57:36.470998 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Type: application/json Aug 09 18:57:36.470998 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Host: 10.222.0.57 Aug 09 18:57:36.470998 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Aug 09 18:57:36.470998 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.11 Aug 09 18:57:36.470998 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABi8q3J9ZMpW2qJVgl-oDicJLlXhAw7jJ13KXPahbCllzijIaBZcstfAPQB8h94MCfE7ykLE93QHxV4QY2UMRff9DBVozFgt62K0UqdIntPi2EHQh2pjC36EqjmgGCdcDZcR3KAa1kwd1Ar_q7tiEUpf2Fzt3CuwIWvedTy3xRxviXclHo Aug 09 18:57:36.470998 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Aug 09 18:57:36.470998 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Aug 09 18:57:36.470998 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Aug 09 18:57:36.470998 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Aug 09 18:57:36.470998 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Aug 09 18:57:36.470998 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Aug 09 18:57:36.470998 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Id: 7e81a89ed40c43f28ac96cbe3744e6c0 Aug 09 18:57:36.470998 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1946863862 Aug 09 18:57:36.470998 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Role: reader,member Aug 09 18:57:36.470998 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Roles: reader,member Aug 09 18:57:36.472765 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_7e81a89ed40c43f28ac96cbe3744e6c0", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7e81a89ed40c43f28ac96cbe3744e6c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/7e81a89ed40c43f28ac96cbe3744e6c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7e81a89ed40c43f28ac96cbe3744e6c0"}]}] Aug 09 18:57:36.472765 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-VolumesSnapshotTestJSON-1946863862 Aug 09 18:57:36.472765 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 7e81a89ed40c43f28ac96cbe3744e6c0 Aug 09 18:57:36.472765 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1946863862 Aug 09 18:57:36.472765 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User: tempest-VolumesSnapshotTestJSON-1946863862-project Aug 09 18:57:36.472765 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Aug 09 18:57:36.472765 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Aug 09 18:57:36.472765 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Id: aa415c4e0e9c4928b51152fa0a428d9b Aug 09 18:57:36.472765 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-VolumesSnapshotTestJSON-1946863862-project Aug 09 18:57:36.472765 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: method: > Aug 09 18:57:36.472765 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: exception: Instance 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37 could not be found. Aug 09 18:57:36.472765 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: action_args: {'id': '9eb9fbf1-ba64-43ee-ab55-edb2768a4b37'} Aug 09 18:57:36.474189 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:57:36.474189 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:57:36.474189 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:57:36.474189 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:57:36.474189 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:57:36.474189 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:57:36.474189 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:57:36.474189 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:57:36.474189 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:57:36.474189 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:57:36.474189 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37 could not be found. Aug 09 18:57:36.474189 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:57:36.474189 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:57:36.474189 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:57:36.474189 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:57:36.474189 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:57:36.474189 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:57:36.474189 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:57:36.474189 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:57:36.474189 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:57:36.475837 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:57:36.475837 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:57:36.475837 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:57:36.475837 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:57:36.475837 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:57:36.475837 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:57:36.475837 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:57:36.475837 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37 could not be found. Aug 09 18:57:36.475837 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:57:36.475837 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:57:36.475837 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:57:36.475837 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:57:36.475837 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:57:36.475837 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:57:36.475837 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:57:36.475837 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:57:36.475837 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37 could not be found. Aug 09 18:57:36.475837 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:57:36.477149 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a9f5892a-223f-4946-aa30-13fd44cc1b1d tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Returning 404 to user: Instance 9eb9fbf1-ba64-43ee-ab55-edb2768a4b37 could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:57:36.477149 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-a9f5892a-223f-4946-aa30-13fd44cc1b1d tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37" status: 404 len: 111 microversion: 2.1 time: 0.032737 Aug 09 18:57:36.477585 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 493/954] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:36 2022] GET /compute/v2.1/servers/9eb9fbf1-ba64-43ee-ab55-edb2768a4b37 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:57:36.687027 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-74d176a8-d42a-494a-a7c7-897bb294f002 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "POST /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212/action" status: 202 len: 0 microversion: 2.1 time: 0.308648 Aug 09 18:57:36.687966 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 462/955] 10.222.0.57 () {60 vars in 1278 bytes} [Tue Aug 9 18:57:36 2022] POST /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:57:36.697301 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-1ffd4a7c-d4fd-4bb5-9ec4-7728e1bfb25a tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:36.697958 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-1ffd4a7c-d4fd-4bb5-9ec4-7728e1bfb25a tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:36.704039 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1ffd4a7c-d4fd-4bb5-9ec4-7728e1bfb25a tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:36.707566 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1ffd4a7c-d4fd-4bb5-9ec4-7728e1bfb25a tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:36.707566 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1ffd4a7c-d4fd-4bb5-9ec4-7728e1bfb25a tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:36.707566 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1ffd4a7c-d4fd-4bb5-9ec4-7728e1bfb25a tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:36.707566 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1ffd4a7c-d4fd-4bb5-9ec4-7728e1bfb25a tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:36.707943 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1ffd4a7c-d4fd-4bb5-9ec4-7728e1bfb25a tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:36.858127 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=2 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:57:36.866708 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1ffd4a7c-d4fd-4bb5-9ec4-7728e1bfb25a tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:36.875768 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-1ffd4a7c-d4fd-4bb5-9ec4-7728e1bfb25a tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1752 microversion: 2.1 time: 0.182884 Aug 09 18:57:36.879807 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 494/956] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:36 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1752 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:57:37.457301 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell0:SELECT=2 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:57:37.468739 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-fa3e475f-7528-443c-ac87-4330bc4c9fea tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:37.468739 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-fa3e475f-7528-443c-ac87-4330bc4c9fea tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: 87fa2c0c-b36e-4990-bda7-bab94f06ca6a] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:37.469057 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fa3e475f-7528-443c-ac87-4330bc4c9fea tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:37.469565 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fa3e475f-7528-443c-ac87-4330bc4c9fea tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:37.470040 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fa3e475f-7528-443c-ac87-4330bc4c9fea tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:37.470748 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fa3e475f-7528-443c-ac87-4330bc4c9fea tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:37.471200 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fa3e475f-7528-443c-ac87-4330bc4c9fea tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:37.471624 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fa3e475f-7528-443c-ac87-4330bc4c9fea tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:37.517704 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-c71368b1-6658-4ed6-9d79-84a51f06a85e req-6599d054-946c-449f-9bb3-1aa7b9256787 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87fa2c0c-b36e-4990-bda7-bab94f06ca6a", "name": "network-vif-plugged", "status": "completed", "tag": "8a1e776e-6f69-48e9-9708-1beda97d8a58"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:57:37.530459 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-c71368b1-6658-4ed6-9d79-84a51f06a85e req-6599d054-946c-449f-9bb3-1aa7b9256787 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:37.531016 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-c71368b1-6658-4ed6-9d79-84a51f06a85e req-6599d054-946c-449f-9bb3-1aa7b9256787 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:37.531550 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-c71368b1-6658-4ed6-9d79-84a51f06a85e req-6599d054-946c-449f-9bb3-1aa7b9256787 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:37.544093 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-c71368b1-6658-4ed6-9d79-84a51f06a85e req-6599d054-946c-449f-9bb3-1aa7b9256787 service nova] Creating event network-vif-plugged:8a1e776e-6f69-48e9-9708-1beda97d8a58 for instance 87fa2c0c-b36e-4990-bda7-bab94f06ca6a on hv-cinder-82660 Aug 09 18:57:37.549033 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-c71368b1-6658-4ed6-9d79-84a51f06a85e req-6599d054-946c-449f-9bb3-1aa7b9256787 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035127 Aug 09 18:57:37.550134 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 495/957] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:57:37.626378 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-fa3e475f-7528-443c-ac87-4330bc4c9fea tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'debdf689e44c48e1bca1c7ad37f8335f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6338088b03415aa67ca34647ca0700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:37.634616 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-fa3e475f-7528-443c-ac87-4330bc4c9fea tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] 10.222.0.57 "GET /compute/v2.1/servers/87fa2c0c-b36e-4990-bda7-bab94f06ca6a" status: 200 len: 1313 microversion: 2.1 time: 0.178243 Aug 09 18:57:37.635260 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 463/958] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:37 2022] GET /compute/v2.1/servers/87fa2c0c-b36e-4990-bda7-bab94f06ca6a => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:57:37.898683 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-3d357def-1509-4d7e-a8b3-6eb2e4b9ed1c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:37.899297 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-3d357def-1509-4d7e-a8b3-6eb2e4b9ed1c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:37.905646 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3d357def-1509-4d7e-a8b3-6eb2e4b9ed1c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:37.906135 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3d357def-1509-4d7e-a8b3-6eb2e4b9ed1c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:37.906566 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3d357def-1509-4d7e-a8b3-6eb2e4b9ed1c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:37.907478 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3d357def-1509-4d7e-a8b3-6eb2e4b9ed1c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:37.907938 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3d357def-1509-4d7e-a8b3-6eb2e4b9ed1c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:37.908363 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3d357def-1509-4d7e-a8b3-6eb2e4b9ed1c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:38.058026 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-3d357def-1509-4d7e-a8b3-6eb2e4b9ed1c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:38.066347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-3d357def-1509-4d7e-a8b3-6eb2e4b9ed1c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1752 microversion: 2.1 time: 0.172257 Aug 09 18:57:38.067082 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 496/959] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:37 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1752 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:57:38.665177 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-b7371195-7d59-4906-a6e5-8acf1af6461c tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:38.665920 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-b7371195-7d59-4906-a6e5-8acf1af6461c tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: 87fa2c0c-b36e-4990-bda7-bab94f06ca6a] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:38.672320 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b7371195-7d59-4906-a6e5-8acf1af6461c tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:38.672793 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b7371195-7d59-4906-a6e5-8acf1af6461c tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:38.673220 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b7371195-7d59-4906-a6e5-8acf1af6461c tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:38.674127 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b7371195-7d59-4906-a6e5-8acf1af6461c tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:38.674571 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b7371195-7d59-4906-a6e5-8acf1af6461c tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:38.674945 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b7371195-7d59-4906-a6e5-8acf1af6461c tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:38.812206 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-b7371195-7d59-4906-a6e5-8acf1af6461c tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'debdf689e44c48e1bca1c7ad37f8335f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6338088b03415aa67ca34647ca0700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:38.819982 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-b7371195-7d59-4906-a6e5-8acf1af6461c tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] 10.222.0.57 "GET /compute/v2.1/servers/87fa2c0c-b36e-4990-bda7-bab94f06ca6a" status: 200 len: 1313 microversion: 2.1 time: 0.159482 Aug 09 18:57:38.820618 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 464/960] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:38 2022] GET /compute/v2.1/servers/87fa2c0c-b36e-4990-bda7-bab94f06ca6a => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:57:39.088448 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-29b274d4-1d1b-49e6-927f-d286107e3325 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:39.089056 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-29b274d4-1d1b-49e6-927f-d286107e3325 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:39.091045 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=8 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:57:39.096364 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-29b274d4-1d1b-49e6-927f-d286107e3325 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:39.098971 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-29b274d4-1d1b-49e6-927f-d286107e3325 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:39.098971 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-29b274d4-1d1b-49e6-927f-d286107e3325 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:39.098971 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-29b274d4-1d1b-49e6-927f-d286107e3325 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:39.098971 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-29b274d4-1d1b-49e6-927f-d286107e3325 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:39.099339 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-29b274d4-1d1b-49e6-927f-d286107e3325 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:39.255494 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-29b274d4-1d1b-49e6-927f-d286107e3325 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:39.264417 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-29b274d4-1d1b-49e6-927f-d286107e3325 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1752 microversion: 2.1 time: 0.180233 Aug 09 18:57:39.265093 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 497/961] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:39 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1752 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:57:39.841090 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-d077e218-fd91-4df2-92b8-e0229d57d0b0 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:39.841700 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-d077e218-fd91-4df2-92b8-e0229d57d0b0 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: 87fa2c0c-b36e-4990-bda7-bab94f06ca6a] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:39.848385 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d077e218-fd91-4df2-92b8-e0229d57d0b0 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:39.848912 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d077e218-fd91-4df2-92b8-e0229d57d0b0 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:39.852874 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d077e218-fd91-4df2-92b8-e0229d57d0b0 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:39.852874 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d077e218-fd91-4df2-92b8-e0229d57d0b0 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:39.852874 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d077e218-fd91-4df2-92b8-e0229d57d0b0 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:39.852874 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d077e218-fd91-4df2-92b8-e0229d57d0b0 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:40.013046 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-d077e218-fd91-4df2-92b8-e0229d57d0b0 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'debdf689e44c48e1bca1c7ad37f8335f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6338088b03415aa67ca34647ca0700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:40.025563 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-d077e218-fd91-4df2-92b8-e0229d57d0b0 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] 10.222.0.57 "GET /compute/v2.1/servers/87fa2c0c-b36e-4990-bda7-bab94f06ca6a" status: 200 len: 1313 microversion: 2.1 time: 0.188528 Aug 09 18:57:40.030825 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 465/962] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:39 2022] GET /compute/v2.1/servers/87fa2c0c-b36e-4990-bda7-bab94f06ca6a => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:57:40.288500 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a3a30d1e-0d98-4204-8950-8ddb0bae06cf tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:40.289739 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-a3a30d1e-0d98-4204-8950-8ddb0bae06cf tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:40.297700 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a3a30d1e-0d98-4204-8950-8ddb0bae06cf tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:40.298038 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a3a30d1e-0d98-4204-8950-8ddb0bae06cf tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:40.298681 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a3a30d1e-0d98-4204-8950-8ddb0bae06cf tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:40.299708 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a3a30d1e-0d98-4204-8950-8ddb0bae06cf tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:40.300176 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a3a30d1e-0d98-4204-8950-8ddb0bae06cf tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:40.300606 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a3a30d1e-0d98-4204-8950-8ddb0bae06cf tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:40.455793 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-a3a30d1e-0d98-4204-8950-8ddb0bae06cf tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:40.463663 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-a3a30d1e-0d98-4204-8950-8ddb0bae06cf tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1757 microversion: 2.1 time: 0.179139 Aug 09 18:57:40.464227 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 498/963] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:40 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:57:41.054397 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-e421cd31-02dc-45f8-9497-cdaacc7b1b4e tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:41.055133 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-e421cd31-02dc-45f8-9497-cdaacc7b1b4e tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: 87fa2c0c-b36e-4990-bda7-bab94f06ca6a] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:41.062396 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e421cd31-02dc-45f8-9497-cdaacc7b1b4e tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:41.063340 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e421cd31-02dc-45f8-9497-cdaacc7b1b4e tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:41.064025 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e421cd31-02dc-45f8-9497-cdaacc7b1b4e tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:41.064894 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e421cd31-02dc-45f8-9497-cdaacc7b1b4e tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:41.065435 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e421cd31-02dc-45f8-9497-cdaacc7b1b4e tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:41.065971 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e421cd31-02dc-45f8-9497-cdaacc7b1b4e tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:41.216220 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-e421cd31-02dc-45f8-9497-cdaacc7b1b4e tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'debdf689e44c48e1bca1c7ad37f8335f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6338088b03415aa67ca34647ca0700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:41.224016 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-e421cd31-02dc-45f8-9497-cdaacc7b1b4e tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] 10.222.0.57 "GET /compute/v2.1/servers/87fa2c0c-b36e-4990-bda7-bab94f06ca6a" status: 200 len: 1313 microversion: 2.1 time: 0.173570 Aug 09 18:57:41.224802 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 466/964] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:41 2022] GET /compute/v2.1/servers/87fa2c0c-b36e-4990-bda7-bab94f06ca6a => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:57:41.485782 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-daf74a17-e423-49c9-9ac6-0e0001d080fa tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:41.486590 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-daf74a17-e423-49c9-9ac6-0e0001d080fa tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:41.494570 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-daf74a17-e423-49c9-9ac6-0e0001d080fa tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:41.495265 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-daf74a17-e423-49c9-9ac6-0e0001d080fa tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:41.495883 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-daf74a17-e423-49c9-9ac6-0e0001d080fa tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:41.496596 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-daf74a17-e423-49c9-9ac6-0e0001d080fa tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:41.497044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-daf74a17-e423-49c9-9ac6-0e0001d080fa tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:41.497465 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-daf74a17-e423-49c9-9ac6-0e0001d080fa tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:41.646968 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-daf74a17-e423-49c9-9ac6-0e0001d080fa tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:41.655047 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-daf74a17-e423-49c9-9ac6-0e0001d080fa tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1757 microversion: 2.1 time: 0.173237 Aug 09 18:57:41.659239 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 499/965] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:41 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:57:42.245575 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-a578c10e-1ba2-4de5-90e4-f90aa917ef61 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:42.246348 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-a578c10e-1ba2-4de5-90e4-f90aa917ef61 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: 87fa2c0c-b36e-4990-bda7-bab94f06ca6a] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:42.253091 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a578c10e-1ba2-4de5-90e4-f90aa917ef61 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:42.253600 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a578c10e-1ba2-4de5-90e4-f90aa917ef61 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:42.254039 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a578c10e-1ba2-4de5-90e4-f90aa917ef61 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:42.254740 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a578c10e-1ba2-4de5-90e4-f90aa917ef61 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:42.255196 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a578c10e-1ba2-4de5-90e4-f90aa917ef61 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:42.255616 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a578c10e-1ba2-4de5-90e4-f90aa917ef61 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:42.393409 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-a578c10e-1ba2-4de5-90e4-f90aa917ef61 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'debdf689e44c48e1bca1c7ad37f8335f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6338088b03415aa67ca34647ca0700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:42.402268 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-a578c10e-1ba2-4de5-90e4-f90aa917ef61 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] 10.222.0.57 "GET /compute/v2.1/servers/87fa2c0c-b36e-4990-bda7-bab94f06ca6a" status: 200 len: 1495 microversion: 2.1 time: 0.161436 Aug 09 18:57:42.402831 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 467/966] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:42 2022] GET /compute/v2.1/servers/87fa2c0c-b36e-4990-bda7-bab94f06ca6a => generated 1495 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:57:42.676429 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-946b9ffc-35a6-4996-8dc7-ae2de0cbe1db tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:42.677069 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-946b9ffc-35a6-4996-8dc7-ae2de0cbe1db tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:42.683646 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-946b9ffc-35a6-4996-8dc7-ae2de0cbe1db tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:42.684158 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-946b9ffc-35a6-4996-8dc7-ae2de0cbe1db tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:42.684597 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-946b9ffc-35a6-4996-8dc7-ae2de0cbe1db tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:42.685302 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-946b9ffc-35a6-4996-8dc7-ae2de0cbe1db tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:42.685892 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-946b9ffc-35a6-4996-8dc7-ae2de0cbe1db tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:42.686320 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-946b9ffc-35a6-4996-8dc7-ae2de0cbe1db tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:42.846204 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-946b9ffc-35a6-4996-8dc7-ae2de0cbe1db tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:42.854663 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-946b9ffc-35a6-4996-8dc7-ae2de0cbe1db tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1757 microversion: 2.1 time: 0.182184 Aug 09 18:57:42.855200 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 500/967] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:42 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1757 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:57:43.254491 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-8a27882e-aa66-4c71-8de7-b28135607e5b tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:43.255075 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-8a27882e-aa66-4c71-8de7-b28135607e5b tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: 87fa2c0c-b36e-4990-bda7-bab94f06ca6a] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:43.261609 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-8a27882e-aa66-4c71-8de7-b28135607e5b tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:43.262100 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-8a27882e-aa66-4c71-8de7-b28135607e5b tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:43.262532 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-8a27882e-aa66-4c71-8de7-b28135607e5b tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:43.263235 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-8a27882e-aa66-4c71-8de7-b28135607e5b tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:43.263693 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-8a27882e-aa66-4c71-8de7-b28135607e5b tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:43.264119 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-8a27882e-aa66-4c71-8de7-b28135607e5b tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:43.289397 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-8a27882e-aa66-4c71-8de7-b28135607e5b tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: 87fa2c0c-b36e-4990-bda7-bab94f06ca6a] Going to try to terminate instance {{(pid=124726) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:57:43.396104 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:57:43.540462 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-8a27882e-aa66-4c71-8de7-b28135607e5b tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] 10.222.0.57 "DELETE /compute/v2.1/servers/87fa2c0c-b36e-4990-bda7-bab94f06ca6a" status: 204 len: 0 microversion: 2.1 time: 0.288924 Aug 09 18:57:43.541159 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 468/968] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 9 18:57:43 2022] DELETE /compute/v2.1/servers/87fa2c0c-b36e-4990-bda7-bab94f06ca6a => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:57:43.549217 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f9e6c49c-ac2a-4cc8-9906-1e3bff7d7ac1 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:43.549901 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-f9e6c49c-ac2a-4cc8-9906-1e3bff7d7ac1 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: 87fa2c0c-b36e-4990-bda7-bab94f06ca6a] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:43.556872 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f9e6c49c-ac2a-4cc8-9906-1e3bff7d7ac1 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:43.557634 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f9e6c49c-ac2a-4cc8-9906-1e3bff7d7ac1 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:43.557823 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f9e6c49c-ac2a-4cc8-9906-1e3bff7d7ac1 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:43.558548 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f9e6c49c-ac2a-4cc8-9906-1e3bff7d7ac1 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:43.559000 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f9e6c49c-ac2a-4cc8-9906-1e3bff7d7ac1 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:43.559466 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f9e6c49c-ac2a-4cc8-9906-1e3bff7d7ac1 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:43.563932 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:57:43.701740 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f9e6c49c-ac2a-4cc8-9906-1e3bff7d7ac1 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'debdf689e44c48e1bca1c7ad37f8335f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6338088b03415aa67ca34647ca0700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:43.711799 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f9e6c49c-ac2a-4cc8-9906-1e3bff7d7ac1 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] 10.222.0.57 "GET /compute/v2.1/servers/87fa2c0c-b36e-4990-bda7-bab94f06ca6a" status: 200 len: 1501 microversion: 2.1 time: 0.166395 Aug 09 18:57:43.712394 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 501/969] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:43 2022] GET /compute/v2.1/servers/87fa2c0c-b36e-4990-bda7-bab94f06ca6a => generated 1501 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:57:43.876287 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-049c3de4-abb6-49ab-84ae-a5d35df18722 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:43.876984 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-049c3de4-abb6-49ab-84ae-a5d35df18722 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:43.883421 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-049c3de4-abb6-49ab-84ae-a5d35df18722 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:43.883905 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-049c3de4-abb6-49ab-84ae-a5d35df18722 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:43.884341 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-049c3de4-abb6-49ab-84ae-a5d35df18722 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:43.885030 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-049c3de4-abb6-49ab-84ae-a5d35df18722 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:43.885485 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-049c3de4-abb6-49ab-84ae-a5d35df18722 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:43.885933 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-049c3de4-abb6-49ab-84ae-a5d35df18722 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:44.040391 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-049c3de4-abb6-49ab-84ae-a5d35df18722 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:44.048373 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-049c3de4-abb6-49ab-84ae-a5d35df18722 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1757 microversion: 2.1 time: 0.176339 Aug 09 18:57:44.054750 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 469/970] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:43 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:57:44.733479 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-82e5ca8c-64a5-4efa-86ff-c5fe3d7e84bd tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:44.734129 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-82e5ca8c-64a5-4efa-86ff-c5fe3d7e84bd tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: 87fa2c0c-b36e-4990-bda7-bab94f06ca6a] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:44.741907 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-82e5ca8c-64a5-4efa-86ff-c5fe3d7e84bd tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:44.742968 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-82e5ca8c-64a5-4efa-86ff-c5fe3d7e84bd tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:44.743407 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-82e5ca8c-64a5-4efa-86ff-c5fe3d7e84bd tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:44.744106 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-82e5ca8c-64a5-4efa-86ff-c5fe3d7e84bd tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:44.744589 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-82e5ca8c-64a5-4efa-86ff-c5fe3d7e84bd tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:44.745013 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-82e5ca8c-64a5-4efa-86ff-c5fe3d7e84bd tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:44.884329 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-82e5ca8c-64a5-4efa-86ff-c5fe3d7e84bd tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'debdf689e44c48e1bca1c7ad37f8335f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6338088b03415aa67ca34647ca0700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:44.889043 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-82e5ca8c-64a5-4efa-86ff-c5fe3d7e84bd tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] 10.222.0.57 "GET /compute/v2.1/servers/87fa2c0c-b36e-4990-bda7-bab94f06ca6a" status: 200 len: 1501 microversion: 2.1 time: 0.159577 Aug 09 18:57:44.889634 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 502/971] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:44 2022] GET /compute/v2.1/servers/87fa2c0c-b36e-4990-bda7-bab94f06ca6a => generated 1501 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:57:45.069999 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-83d3031b-dab9-4708-bd8b-8ec31e21f6c4 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:45.071171 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-83d3031b-dab9-4708-bd8b-8ec31e21f6c4 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:45.077688 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-83d3031b-dab9-4708-bd8b-8ec31e21f6c4 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:45.078173 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-83d3031b-dab9-4708-bd8b-8ec31e21f6c4 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:45.078614 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-83d3031b-dab9-4708-bd8b-8ec31e21f6c4 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:45.079307 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-83d3031b-dab9-4708-bd8b-8ec31e21f6c4 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:45.079761 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-83d3031b-dab9-4708-bd8b-8ec31e21f6c4 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:45.080186 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-83d3031b-dab9-4708-bd8b-8ec31e21f6c4 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:45.225094 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-83d3031b-dab9-4708-bd8b-8ec31e21f6c4 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:45.233145 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-83d3031b-dab9-4708-bd8b-8ec31e21f6c4 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1757 microversion: 2.1 time: 0.167274 Aug 09 18:57:45.233756 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 470/972] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:45 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:57:45.910198 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-719ecf8e-5536-4db8-b15d-dfa1f358a6d8 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:45.910874 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-719ecf8e-5536-4db8-b15d-dfa1f358a6d8 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: 87fa2c0c-b36e-4990-bda7-bab94f06ca6a] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:45.917672 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-719ecf8e-5536-4db8-b15d-dfa1f358a6d8 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:45.918157 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-719ecf8e-5536-4db8-b15d-dfa1f358a6d8 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:45.918584 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-719ecf8e-5536-4db8-b15d-dfa1f358a6d8 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:45.919314 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-719ecf8e-5536-4db8-b15d-dfa1f358a6d8 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:45.919762 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-719ecf8e-5536-4db8-b15d-dfa1f358a6d8 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:45.920178 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-719ecf8e-5536-4db8-b15d-dfa1f358a6d8 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:46.060155 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-719ecf8e-5536-4db8-b15d-dfa1f358a6d8 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'debdf689e44c48e1bca1c7ad37f8335f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6338088b03415aa67ca34647ca0700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:46.068350 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-719ecf8e-5536-4db8-b15d-dfa1f358a6d8 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] 10.222.0.57 "GET /compute/v2.1/servers/87fa2c0c-b36e-4990-bda7-bab94f06ca6a" status: 200 len: 1501 microversion: 2.1 time: 0.161908 Aug 09 18:57:46.068965 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 503/973] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:45 2022] GET /compute/v2.1/servers/87fa2c0c-b36e-4990-bda7-bab94f06ca6a => generated 1501 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:57:46.254297 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-aea83dd9-f005-4a6d-ac03-7d747083d89b tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:46.255030 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-aea83dd9-f005-4a6d-ac03-7d747083d89b tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:46.261776 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-aea83dd9-f005-4a6d-ac03-7d747083d89b tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:46.268411 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-aea83dd9-f005-4a6d-ac03-7d747083d89b tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:46.268411 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-aea83dd9-f005-4a6d-ac03-7d747083d89b tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:46.268411 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-aea83dd9-f005-4a6d-ac03-7d747083d89b tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:46.268411 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-aea83dd9-f005-4a6d-ac03-7d747083d89b tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:46.268798 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-aea83dd9-f005-4a6d-ac03-7d747083d89b tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:46.418757 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-aea83dd9-f005-4a6d-ac03-7d747083d89b tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:46.426975 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-aea83dd9-f005-4a6d-ac03-7d747083d89b tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1757 microversion: 2.1 time: 0.176625 Aug 09 18:57:46.427572 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 471/974] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:46 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:57:47.046606 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-3bca710a-da36-4508-a6fb-7e6f2ed17b81 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1301596622", "imageRef": "124dd477-ccfa-4be3-9973-6b1f33b47df8", "flavorRef": "452", "networks": [{"uuid": "fb9b1070-1154-42f7-9f77-53f9652718c0"}]}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:57:47.089688 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-72c47f55-9910-442e-b9ec-e62439578297 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:47.090311 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-72c47f55-9910-442e-b9ec-e62439578297 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: 87fa2c0c-b36e-4990-bda7-bab94f06ca6a] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:47.097091 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-72c47f55-9910-442e-b9ec-e62439578297 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:47.097808 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-72c47f55-9910-442e-b9ec-e62439578297 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:47.098266 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-72c47f55-9910-442e-b9ec-e62439578297 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:47.099071 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-72c47f55-9910-442e-b9ec-e62439578297 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:47.099434 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-72c47f55-9910-442e-b9ec-e62439578297 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:47.099861 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-72c47f55-9910-442e-b9ec-e62439578297 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:47.104486 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.network.neutron [None req-3bca710a-da36-4508-a6fb-7e6f2ed17b81 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] validate_networks() for [('fb9b1070-1154-42f7-9f77-53f9652718c0', None, None, None, None, None)] {{(pid=124725) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:57:47.314189 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-72c47f55-9910-442e-b9ec-e62439578297 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'debdf689e44c48e1bca1c7ad37f8335f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6338088b03415aa67ca34647ca0700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:47.323837 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-72c47f55-9910-442e-b9ec-e62439578297 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] 10.222.0.57 "GET /compute/v2.1/servers/87fa2c0c-b36e-4990-bda7-bab94f06ca6a" status: 200 len: 1501 microversion: 2.1 time: 0.238483 Aug 09 18:57:47.324422 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 472/975] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:47 2022] GET /compute/v2.1/servers/87fa2c0c-b36e-4990-bda7-bab94f06ca6a => generated 1501 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:57:47.449152 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-b32a7cdd-c25d-4045-a0cf-f88bc59375ab tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:47.450213 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-b32a7cdd-c25d-4045-a0cf-f88bc59375ab tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:47.459067 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b32a7cdd-c25d-4045-a0cf-f88bc59375ab tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:47.465940 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b32a7cdd-c25d-4045-a0cf-f88bc59375ab tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:47.465940 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b32a7cdd-c25d-4045-a0cf-f88bc59375ab tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:47.465940 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b32a7cdd-c25d-4045-a0cf-f88bc59375ab tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:47.465940 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b32a7cdd-c25d-4045-a0cf-f88bc59375ab tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:47.466360 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b32a7cdd-c25d-4045-a0cf-f88bc59375ab tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:47.519307 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-3bca710a-da36-4508-a6fb-7e6f2ed17b81 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Flavor limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:57:47.520240 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-3bca710a-da36-4508-a6fb-7e6f2ed17b81 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Image limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:57:47.521162 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-3bca710a-da36-4508-a6fb-7e6f2ed17b81 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Flavor pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:57:47.521625 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-3bca710a-da36-4508-a6fb-7e6f2ed17b81 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Image pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:57:47.522042 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-3bca710a-da36-4508-a6fb-7e6f2ed17b81 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:57:47.532445 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3bca710a-da36-4508-a6fb-7e6f2ed17b81 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:47.533176 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3bca710a-da36-4508-a6fb-7e6f2ed17b81 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:47.534133 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3bca710a-da36-4508-a6fb-7e6f2ed17b81 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:47.535286 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3bca710a-da36-4508-a6fb-7e6f2ed17b81 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:47.536084 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3bca710a-da36-4508-a6fb-7e6f2ed17b81 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:47.536668 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3bca710a-da36-4508-a6fb-7e6f2ed17b81 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:47.555326 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-3bca710a-da36-4508-a6fb-7e6f2ed17b81 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Getting quotas for project 7e81a89ed40c43f28ac96cbe3744e6c0. Resources: {'cores', 'ram', 'instances'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:57:47.560249 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-3bca710a-da36-4508-a6fb-7e6f2ed17b81 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Getting quotas for user aa415c4e0e9c4928b51152fa0a428d9b and project 7e81a89ed40c43f28ac96cbe3744e6c0. Resources: {'cores', 'ram', 'instances'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:57:47.573578 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-3bca710a-da36-4508-a6fb-7e6f2ed17b81 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Going to run 1 instances... {{(pid=124725) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:57:47.575865 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-3bca710a-da36-4508-a6fb-7e6f2ed17b81 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 77c72fb6-9a7c-43e4-9849-3eb79380b31b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='124dd477-ccfa-4be3-9973-6b1f33b47df8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:57:47.687003 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-b32a7cdd-c25d-4045-a0cf-f88bc59375ab tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:47.696040 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-b32a7cdd-c25d-4045-a0cf-f88bc59375ab tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1757 microversion: 2.1 time: 0.251662 Aug 09 18:57:47.696648 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 473/976] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:47 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1757 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:57:47.713117 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-3bca710a-da36-4508-a6fb-7e6f2ed17b81 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.670501 Aug 09 18:57:47.720790 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 504/977] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 9 18:57:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:57:47.736985 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-e2d65cad-0073-47f5-8234-f2535a56a53e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:47.742564 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-e2d65cad-0073-47f5-8234-f2535a56a53e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 77c72fb6-9a7c-43e4-9849-3eb79380b31b] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:47.829319 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-ce0fc874-5247-4f65-8c1a-d9383c4dec92 req-76e5b286-8f10-42c8-a5b6-2ce7cace095c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87fa2c0c-b36e-4990-bda7-bab94f06ca6a", "name": "network-vif-deleted", "tag": "8a1e776e-6f69-48e9-9708-1beda97d8a58"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:57:47.845288 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-ce0fc874-5247-4f65-8c1a-d9383c4dec92 req-76e5b286-8f10-42c8-a5b6-2ce7cace095c service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:47.845798 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-ce0fc874-5247-4f65-8c1a-d9383c4dec92 req-76e5b286-8f10-42c8-a5b6-2ce7cace095c service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:47.846261 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-ce0fc874-5247-4f65-8c1a-d9383c4dec92 req-76e5b286-8f10-42c8-a5b6-2ce7cace095c service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:47.859558 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-ce0fc874-5247-4f65-8c1a-d9383c4dec92 req-76e5b286-8f10-42c8-a5b6-2ce7cace095c service nova] Creating event network-vif-deleted:8a1e776e-6f69-48e9-9708-1beda97d8a58 for instance 87fa2c0c-b36e-4990-bda7-bab94f06ca6a on hv-cinder-82660 Aug 09 18:57:47.864858 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-e2d65cad-0073-47f5-8234-f2535a56a53e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:47.865317 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-ce0fc874-5247-4f65-8c1a-d9383c4dec92 req-76e5b286-8f10-42c8-a5b6-2ce7cace095c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042213 Aug 09 18:57:47.866313 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 505/978] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:57:47.873440 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-e2d65cad-0073-47f5-8234-f2535a56a53e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b" status: 200 len: 1219 microversion: 2.1 time: 0.145773 Aug 09 18:57:47.874407 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 474/979] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:47 2022] GET /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b => generated 1219 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:57:48.346339 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-886fb8c3-f804-43a7-b1be-2782380a8e52 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:48.347206 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-886fb8c3-f804-43a7-b1be-2782380a8e52 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: 87fa2c0c-b36e-4990-bda7-bab94f06ca6a] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:48.353503 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-886fb8c3-f804-43a7-b1be-2782380a8e52 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:48.354213 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-886fb8c3-f804-43a7-b1be-2782380a8e52 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:48.354645 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-886fb8c3-f804-43a7-b1be-2782380a8e52 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:48.355344 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-886fb8c3-f804-43a7-b1be-2782380a8e52 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:48.355997 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-886fb8c3-f804-43a7-b1be-2782380a8e52 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:48.356385 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-886fb8c3-f804-43a7-b1be-2782380a8e52 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:48.389904 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-886fb8c3-f804-43a7-b1be-2782380a8e52 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:48.390387 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-886fb8c3-f804-43a7-b1be-2782380a8e52 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:48.390816 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-886fb8c3-f804-43a7-b1be-2782380a8e52 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:48.391260 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.objects.instance [None req-886fb8c3-f804-43a7-b1be-2782380a8e52 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lazy-loading 'fault' on Instance uuid 87fa2c0c-b36e-4990-bda7-bab94f06ca6a {{(pid=124725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:57:48.434833 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-886fb8c3-f804-43a7-b1be-2782380a8e52 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'debdf689e44c48e1bca1c7ad37f8335f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6338088b03415aa67ca34647ca0700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:48.442714 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-886fb8c3-f804-43a7-b1be-2782380a8e52 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] 10.222.0.57 "GET /compute/v2.1/servers/87fa2c0c-b36e-4990-bda7-bab94f06ca6a" status: 200 len: 1303 microversion: 2.1 time: 0.101335 Aug 09 18:57:48.443319 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 506/980] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:48 2022] GET /compute/v2.1/servers/87fa2c0c-b36e-4990-bda7-bab94f06ca6a => generated 1303 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:57:48.717326 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-5e0e50ef-f766-4fbf-ae8e-1f4a1b632893 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:48.717977 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-5e0e50ef-f766-4fbf-ae8e-1f4a1b632893 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:48.725889 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5e0e50ef-f766-4fbf-ae8e-1f4a1b632893 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:48.727028 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5e0e50ef-f766-4fbf-ae8e-1f4a1b632893 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:48.727470 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5e0e50ef-f766-4fbf-ae8e-1f4a1b632893 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:48.728183 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5e0e50ef-f766-4fbf-ae8e-1f4a1b632893 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:48.728635 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5e0e50ef-f766-4fbf-ae8e-1f4a1b632893 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:48.730044 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5e0e50ef-f766-4fbf-ae8e-1f4a1b632893 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:48.887565 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-5e0e50ef-f766-4fbf-ae8e-1f4a1b632893 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:48.895971 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-5e0e50ef-f766-4fbf-ae8e-1f4a1b632893 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1757 microversion: 2.1 time: 0.182574 Aug 09 18:57:48.896534 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 475/981] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:48 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1757 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:57:48.897492 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-4484e5fd-a8b7-4d44-9e45-93849a39bf66 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:48.898176 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-4484e5fd-a8b7-4d44-9e45-93849a39bf66 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 77c72fb6-9a7c-43e4-9849-3eb79380b31b] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:48.904286 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4484e5fd-a8b7-4d44-9e45-93849a39bf66 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:48.904764 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4484e5fd-a8b7-4d44-9e45-93849a39bf66 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:48.905198 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4484e5fd-a8b7-4d44-9e45-93849a39bf66 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:48.906008 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4484e5fd-a8b7-4d44-9e45-93849a39bf66 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:48.906469 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4484e5fd-a8b7-4d44-9e45-93849a39bf66 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:48.906935 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4484e5fd-a8b7-4d44-9e45-93849a39bf66 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:48.981350 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-4484e5fd-a8b7-4d44-9e45-93849a39bf66 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:48.989236 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-4484e5fd-a8b7-4d44-9e45-93849a39bf66 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b" status: 200 len: 1223 microversion: 2.1 time: 0.095732 Aug 09 18:57:48.989732 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 507/982] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:48 2022] GET /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b => generated 1223 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:57:49.465649 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-c677a606-c24d-404b-9e9c-4a4908a0953f tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:49.466298 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-c677a606-c24d-404b-9e9c-4a4908a0953f tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: 87fa2c0c-b36e-4990-bda7-bab94f06ca6a] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:49.472420 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c677a606-c24d-404b-9e9c-4a4908a0953f tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:49.472904 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c677a606-c24d-404b-9e9c-4a4908a0953f tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:49.473337 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c677a606-c24d-404b-9e9c-4a4908a0953f tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:49.474081 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c677a606-c24d-404b-9e9c-4a4908a0953f tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:49.474565 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c677a606-c24d-404b-9e9c-4a4908a0953f tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:49.474991 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c677a606-c24d-404b-9e9c-4a4908a0953f tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:49.489125 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.wsgi [None req-c677a606-c24d-404b-9e9c-4a4908a0953f tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] HTTP exception thrown: Instance 87fa2c0c-b36e-4990-bda7-bab94f06ca6a could not be found. Aug 09 18:57:49.490809 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-c677a606-c24d-404b-9e9c-4a4908a0953f tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Request method failure captured: Aug 09 18:57:49.490809 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: request: GET /compute/v2.1/servers/87fa2c0c-b36e-4990-bda7-bab94f06ca6a HTTP/1.1 Aug 09 18:57:49.490809 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept: application/json Aug 09 18:57:49.490809 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept-Encoding: identity Aug 09 18:57:49.490809 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Connection: close Aug 09 18:57:49.490809 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Length: 0 Aug 09 18:57:49.490809 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Type: application/json Aug 09 18:57:49.490809 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Host: 10.222.0.57 Aug 09 18:57:49.490809 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Openstack-System-Scope: None Aug 09 18:57:49.490809 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: User-Agent: python-urllib3/1.26.11 Aug 09 18:57:49.490809 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Auth-Token: gAAAAABi8q4Tq9U42_Z4uvEDWvAn2e8rM6WmAJ-ZSXcRz36qDv2ZsWcwDD1SW-w2hk0GBIn1FXhwD6Vykpn_iYLkJlB75nU26B6e-IQjvoS8NzgnEb33jF1cGZ4X6XXk4tuUIxlJqe7WReJgxvPE3F_5_63fg1fp_2KgWkONBAroVb61GBYHrOw Aug 09 18:57:49.490809 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Id: None Aug 09 18:57:49.490809 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Name: None Aug 09 18:57:49.490809 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Identity-Status: Confirmed Aug 09 18:57:49.490809 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Is-Admin-Project: True Aug 09 18:57:49.490809 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Id: default Aug 09 18:57:49.490809 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Name: Default Aug 09 18:57:49.490809 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Id: 8b6338088b03415aa67ca34647ca0700 Aug 09 18:57:49.490809 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Name: tempest-VolumesActionsTest-1188152317 Aug 09 18:57:49.490809 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Role: reader,member Aug 09 18:57:49.490809 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Roles: reader,member Aug 09 18:57:49.493028 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8b6338088b03415aa67ca34647ca0700", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8b6338088b03415aa67ca34647ca0700"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8b6338088b03415aa67ca34647ca0700"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8b6338088b03415aa67ca34647ca0700"}]}] Aug 09 18:57:49.493028 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant: tempest-VolumesActionsTest-1188152317 Aug 09 18:57:49.493028 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Id: 8b6338088b03415aa67ca34647ca0700 Aug 09 18:57:49.493028 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Name: tempest-VolumesActionsTest-1188152317 Aug 09 18:57:49.493028 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User: tempest-VolumesActionsTest-1188152317-project Aug 09 18:57:49.493028 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Id: default Aug 09 18:57:49.493028 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Name: Default Aug 09 18:57:49.493028 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Id: debdf689e44c48e1bca1c7ad37f8335f Aug 09 18:57:49.493028 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Name: tempest-VolumesActionsTest-1188152317-project Aug 09 18:57:49.493028 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: method: > Aug 09 18:57:49.493028 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: exception: Instance 87fa2c0c-b36e-4990-bda7-bab94f06ca6a could not be found. Aug 09 18:57:49.493028 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: action_args: {'id': '87fa2c0c-b36e-4990-bda7-bab94f06ca6a'} Aug 09 18:57:49.494022 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:57:49.494022 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:57:49.494022 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:57:49.494022 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:57:49.494022 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:57:49.494022 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:57:49.494022 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:57:49.494022 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:57:49.494022 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:57:49.494022 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:57:49.494022 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87fa2c0c-b36e-4990-bda7-bab94f06ca6a could not be found. Aug 09 18:57:49.494022 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:57:49.494022 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:57:49.494022 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:57:49.494022 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:57:49.494022 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:57:49.494022 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:57:49.494022 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:57:49.494022 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:57:49.494022 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:57:49.495467 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:57:49.495467 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:57:49.495467 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:57:49.495467 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:57:49.495467 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:57:49.495467 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:57:49.495467 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:57:49.495467 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87fa2c0c-b36e-4990-bda7-bab94f06ca6a could not be found. Aug 09 18:57:49.495467 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:57:49.495467 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:57:49.495467 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:57:49.495467 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:57:49.495467 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:57:49.495467 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:57:49.495467 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:57:49.495467 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:57:49.495467 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87fa2c0c-b36e-4990-bda7-bab94f06ca6a could not be found. Aug 09 18:57:49.495467 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 18:57:49.497116 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-c677a606-c24d-404b-9e9c-4a4908a0953f tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Returning 404 to user: Instance 87fa2c0c-b36e-4990-bda7-bab94f06ca6a could not be found. {{(pid=124726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:57:49.497116 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-c677a606-c24d-404b-9e9c-4a4908a0953f tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] 10.222.0.57 "GET /compute/v2.1/servers/87fa2c0c-b36e-4990-bda7-bab94f06ca6a" status: 404 len: 111 microversion: 2.1 time: 0.031678 Aug 09 18:57:49.497116 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 476/983] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:49 2022] GET /compute/v2.1/servers/87fa2c0c-b36e-4990-bda7-bab94f06ca6a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:57:49.603800 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-6876066f-9e2b-4ad3-93fe-2e31b1f899f7 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-200930740", "imageRef": "124dd477-ccfa-4be3-9973-6b1f33b47df8", "flavorRef": "452", "networks": [{"uuid": "6867efd8-34f8-4d8b-8081-9f5fd287cb5a"}]}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:57:49.656932 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.network.neutron [None req-6876066f-9e2b-4ad3-93fe-2e31b1f899f7 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] validate_networks() for [('6867efd8-34f8-4d8b-8081-9f5fd287cb5a', None, None, None, None, None)] {{(pid=124725) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:57:49.916920 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-022637bc-2cc9-477e-b707-25a1d5856c41 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:49.917703 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-022637bc-2cc9-477e-b707-25a1d5856c41 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:49.924232 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-022637bc-2cc9-477e-b707-25a1d5856c41 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:49.924958 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-022637bc-2cc9-477e-b707-25a1d5856c41 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:49.925737 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-022637bc-2cc9-477e-b707-25a1d5856c41 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:49.926729 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-022637bc-2cc9-477e-b707-25a1d5856c41 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:49.927406 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-022637bc-2cc9-477e-b707-25a1d5856c41 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:49.928686 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-022637bc-2cc9-477e-b707-25a1d5856c41 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:50.089598 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-6876066f-9e2b-4ad3-93fe-2e31b1f899f7 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Flavor limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:57:50.090027 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-6876066f-9e2b-4ad3-93fe-2e31b1f899f7 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Image limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:57:50.090503 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-6876066f-9e2b-4ad3-93fe-2e31b1f899f7 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Flavor pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:57:50.090904 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-6876066f-9e2b-4ad3-93fe-2e31b1f899f7 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Image pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:57:50.091331 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-6876066f-9e2b-4ad3-93fe-2e31b1f899f7 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:57:50.100180 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6876066f-9e2b-4ad3-93fe-2e31b1f899f7 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:50.100663 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6876066f-9e2b-4ad3-93fe-2e31b1f899f7 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:50.101095 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6876066f-9e2b-4ad3-93fe-2e31b1f899f7 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:50.102732 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6876066f-9e2b-4ad3-93fe-2e31b1f899f7 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:50.103183 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6876066f-9e2b-4ad3-93fe-2e31b1f899f7 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:50.103676 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6876066f-9e2b-4ad3-93fe-2e31b1f899f7 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:50.122387 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-6876066f-9e2b-4ad3-93fe-2e31b1f899f7 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Getting quotas for project 8b6338088b03415aa67ca34647ca0700. Resources: {'cores', 'ram', 'instances'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:57:50.126389 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-6876066f-9e2b-4ad3-93fe-2e31b1f899f7 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Getting quotas for user debdf689e44c48e1bca1c7ad37f8335f and project 8b6338088b03415aa67ca34647ca0700. Resources: {'cores', 'ram', 'instances'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:57:50.137827 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-6876066f-9e2b-4ad3-93fe-2e31b1f899f7 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Going to run 1 instances... {{(pid=124725) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:57:50.140122 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-6876066f-9e2b-4ad3-93fe-2e31b1f899f7 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: f5a47886-efa7-4829-892c-66f1002433f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='124dd477-ccfa-4be3-9973-6b1f33b47df8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:57:50.151918 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:57:50.190286 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-022637bc-2cc9-477e-b707-25a1d5856c41 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:50.203653 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-022637bc-2cc9-477e-b707-25a1d5856c41 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1757 microversion: 2.1 time: 0.290905 Aug 09 18:57:50.204757 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 477/984] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:49 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1757 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:57:50.210563 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-3c28946f-abfe-4bc3-8c81-5a423aaea101 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:50.212719 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-3c28946f-abfe-4bc3-8c81-5a423aaea101 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 77c72fb6-9a7c-43e4-9849-3eb79380b31b] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:50.218486 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3c28946f-abfe-4bc3-8c81-5a423aaea101 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:50.219088 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3c28946f-abfe-4bc3-8c81-5a423aaea101 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:50.219787 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3c28946f-abfe-4bc3-8c81-5a423aaea101 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:50.220691 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3c28946f-abfe-4bc3-8c81-5a423aaea101 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:50.221146 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3c28946f-abfe-4bc3-8c81-5a423aaea101 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:50.221603 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3c28946f-abfe-4bc3-8c81-5a423aaea101 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:50.295580 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-3c28946f-abfe-4bc3-8c81-5a423aaea101 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:50.304226 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-3c28946f-abfe-4bc3-8c81-5a423aaea101 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b" status: 200 len: 1289 microversion: 2.1 time: 0.097718 Aug 09 18:57:50.305732 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 478/985] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:50 2022] GET /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b => generated 1289 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:57:50.315841 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-6876066f-9e2b-4ad3-93fe-2e31b1f899f7 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.717009 Aug 09 18:57:50.316552 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 508/986] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 9 18:57:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:57:50.329324 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-55413210-521d-41f7-92bd-7a7263a49bbb tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:50.330077 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-55413210-521d-41f7-92bd-7a7263a49bbb tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: f5a47886-efa7-4829-892c-66f1002433f6] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:50.418341 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-55413210-521d-41f7-92bd-7a7263a49bbb tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'debdf689e44c48e1bca1c7ad37f8335f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6338088b03415aa67ca34647ca0700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:50.430680 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-55413210-521d-41f7-92bd-7a7263a49bbb tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a47886-efa7-4829-892c-66f1002433f6" status: 200 len: 1213 microversion: 2.1 time: 0.104192 Aug 09 18:57:50.431499 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 479/987] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:50 2022] GET /compute/v2.1/servers/f5a47886-efa7-4829-892c-66f1002433f6 => generated 1213 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:57:51.229426 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-73bbfca3-8552-4a92-a5c1-d97892a360a3 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:51.230129 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-73bbfca3-8552-4a92-a5c1-d97892a360a3 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:51.237906 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-73bbfca3-8552-4a92-a5c1-d97892a360a3 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:51.238769 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-73bbfca3-8552-4a92-a5c1-d97892a360a3 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:51.239228 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-73bbfca3-8552-4a92-a5c1-d97892a360a3 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:51.239947 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-73bbfca3-8552-4a92-a5c1-d97892a360a3 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:51.240407 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-73bbfca3-8552-4a92-a5c1-d97892a360a3 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:51.241033 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-73bbfca3-8552-4a92-a5c1-d97892a360a3 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:51.338210 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-078e79dd-f83a-4ef0-88f7-46023a1c7e80 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:51.342802 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-078e79dd-f83a-4ef0-88f7-46023a1c7e80 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 77c72fb6-9a7c-43e4-9849-3eb79380b31b] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:51.354761 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-078e79dd-f83a-4ef0-88f7-46023a1c7e80 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:51.357374 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-078e79dd-f83a-4ef0-88f7-46023a1c7e80 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:51.357919 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-078e79dd-f83a-4ef0-88f7-46023a1c7e80 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:51.358711 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-078e79dd-f83a-4ef0-88f7-46023a1c7e80 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:51.359412 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-078e79dd-f83a-4ef0-88f7-46023a1c7e80 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:51.365729 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-078e79dd-f83a-4ef0-88f7-46023a1c7e80 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:51.577272 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-078e79dd-f83a-4ef0-88f7-46023a1c7e80 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:51.590536 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-078e79dd-f83a-4ef0-88f7-46023a1c7e80 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b" status: 200 len: 1319 microversion: 2.1 time: 0.263281 Aug 09 18:57:51.593192 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 480/988] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:51 2022] GET /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:57:51.598757 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-25ae3cdd-2d36-4e8d-958a-89d38e2b7a44 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:51.599734 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-25ae3cdd-2d36-4e8d-958a-89d38e2b7a44 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: f5a47886-efa7-4829-892c-66f1002433f6] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:51.606996 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-25ae3cdd-2d36-4e8d-958a-89d38e2b7a44 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:51.607789 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-25ae3cdd-2d36-4e8d-958a-89d38e2b7a44 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:51.608381 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-25ae3cdd-2d36-4e8d-958a-89d38e2b7a44 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:51.609250 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-25ae3cdd-2d36-4e8d-958a-89d38e2b7a44 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:51.609893 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-25ae3cdd-2d36-4e8d-958a-89d38e2b7a44 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:51.610699 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-25ae3cdd-2d36-4e8d-958a-89d38e2b7a44 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:51.670005 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-73bbfca3-8552-4a92-a5c1-d97892a360a3 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:51.678018 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-73bbfca3-8552-4a92-a5c1-d97892a360a3 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1757 microversion: 2.1 time: 0.453881 Aug 09 18:57:51.678609 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 509/989] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:51 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1757 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:57:51.710829 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-25ae3cdd-2d36-4e8d-958a-89d38e2b7a44 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'debdf689e44c48e1bca1c7ad37f8335f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6338088b03415aa67ca34647ca0700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:51.718779 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-25ae3cdd-2d36-4e8d-958a-89d38e2b7a44 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a47886-efa7-4829-892c-66f1002433f6" status: 200 len: 1217 microversion: 2.1 time: 0.124283 Aug 09 18:57:51.720052 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 481/990] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:51 2022] GET /compute/v2.1/servers/f5a47886-efa7-4829-892c-66f1002433f6 => generated 1217 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:57:52.420366 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-8eea816f-16ac-4b47-b7c9-1fcebad73db2 req-843bb2b2-5cf8-434c-86a9-48eb3277402d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77c72fb6-9a7c-43e4-9849-3eb79380b31b", "tag": "e40ff188-6781-440f-90b6-a548ddce22f8"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:57:52.432252 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-8eea816f-16ac-4b47-b7c9-1fcebad73db2 req-843bb2b2-5cf8-434c-86a9-48eb3277402d service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:52.433080 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-8eea816f-16ac-4b47-b7c9-1fcebad73db2 req-843bb2b2-5cf8-434c-86a9-48eb3277402d service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:52.433861 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-8eea816f-16ac-4b47-b7c9-1fcebad73db2 req-843bb2b2-5cf8-434c-86a9-48eb3277402d service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:52.446766 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-8eea816f-16ac-4b47-b7c9-1fcebad73db2 req-843bb2b2-5cf8-434c-86a9-48eb3277402d service nova] Creating event network-changed:e40ff188-6781-440f-90b6-a548ddce22f8 for instance 77c72fb6-9a7c-43e4-9849-3eb79380b31b on hv-cinder-82660 Aug 09 18:57:52.453670 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-8eea816f-16ac-4b47-b7c9-1fcebad73db2 req-843bb2b2-5cf8-434c-86a9-48eb3277402d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037027 Aug 09 18:57:52.454358 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 510/991] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:57:52.616753 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-50f1a8d5-9365-4995-977e-fef0f02c35ed tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:52.618097 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-50f1a8d5-9365-4995-977e-fef0f02c35ed tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 77c72fb6-9a7c-43e4-9849-3eb79380b31b] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:52.624882 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-50f1a8d5-9365-4995-977e-fef0f02c35ed tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:52.625367 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-50f1a8d5-9365-4995-977e-fef0f02c35ed tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:52.625841 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-50f1a8d5-9365-4995-977e-fef0f02c35ed tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:52.626549 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-50f1a8d5-9365-4995-977e-fef0f02c35ed tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:52.627007 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-50f1a8d5-9365-4995-977e-fef0f02c35ed tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:52.627431 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-50f1a8d5-9365-4995-977e-fef0f02c35ed tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:52.701991 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b13f9fbe-46cc-4e92-a49a-da506da3c7d4 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:52.702705 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-b13f9fbe-46cc-4e92-a49a-da506da3c7d4 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:52.710063 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b13f9fbe-46cc-4e92-a49a-da506da3c7d4 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:52.710554 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b13f9fbe-46cc-4e92-a49a-da506da3c7d4 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:52.711023 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b13f9fbe-46cc-4e92-a49a-da506da3c7d4 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:52.712345 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b13f9fbe-46cc-4e92-a49a-da506da3c7d4 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:52.725787 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b13f9fbe-46cc-4e92-a49a-da506da3c7d4 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:52.725787 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b13f9fbe-46cc-4e92-a49a-da506da3c7d4 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:52.895587 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-b13f9fbe-46cc-4e92-a49a-da506da3c7d4 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:52.904468 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-b13f9fbe-46cc-4e92-a49a-da506da3c7d4 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1757 microversion: 2.1 time: 0.206787 Aug 09 18:57:52.905048 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 511/992] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:52 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1757 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:57:52.910197 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e5603aab-fb75-41b3-8522-b95ace06ead5 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:52.911005 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e5603aab-fb75-41b3-8522-b95ace06ead5 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: f5a47886-efa7-4829-892c-66f1002433f6] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:52.917435 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e5603aab-fb75-41b3-8522-b95ace06ead5 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:52.918151 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e5603aab-fb75-41b3-8522-b95ace06ead5 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:52.918873 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e5603aab-fb75-41b3-8522-b95ace06ead5 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:52.919654 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e5603aab-fb75-41b3-8522-b95ace06ead5 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:52.920290 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e5603aab-fb75-41b3-8522-b95ace06ead5 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:52.920766 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e5603aab-fb75-41b3-8522-b95ace06ead5 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:52.992543 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e5603aab-fb75-41b3-8522-b95ace06ead5 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'debdf689e44c48e1bca1c7ad37f8335f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6338088b03415aa67ca34647ca0700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:53.001734 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e5603aab-fb75-41b3-8522-b95ace06ead5 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a47886-efa7-4829-892c-66f1002433f6" status: 200 len: 1283 microversion: 2.1 time: 0.095499 Aug 09 18:57:53.014324 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 512/993] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:52 2022] GET /compute/v2.1/servers/f5a47886-efa7-4829-892c-66f1002433f6 => generated 1283 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:57:53.019562 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-50f1a8d5-9365-4995-977e-fef0f02c35ed tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:53.031552 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-50f1a8d5-9365-4995-977e-fef0f02c35ed tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b" status: 200 len: 1319 microversion: 2.1 time: 0.418766 Aug 09 18:57:53.034271 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 482/994] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:52 2022] GET /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b => generated 1319 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:57:53.930852 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-7dc0f8e9-ee43-4f06-86cb-f7ba7931d11c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:53.931450 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-7dc0f8e9-ee43-4f06-86cb-f7ba7931d11c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:53.938252 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7dc0f8e9-ee43-4f06-86cb-f7ba7931d11c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:53.938727 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7dc0f8e9-ee43-4f06-86cb-f7ba7931d11c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:53.939152 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7dc0f8e9-ee43-4f06-86cb-f7ba7931d11c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:53.939827 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7dc0f8e9-ee43-4f06-86cb-f7ba7931d11c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:53.940430 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7dc0f8e9-ee43-4f06-86cb-f7ba7931d11c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:53.940846 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7dc0f8e9-ee43-4f06-86cb-f7ba7931d11c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:54.033991 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-21adbddb-4bdf-4976-88a2-5870fa2ad8c4 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:54.034600 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-21adbddb-4bdf-4976-88a2-5870fa2ad8c4 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: f5a47886-efa7-4829-892c-66f1002433f6] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:54.041968 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-21adbddb-4bdf-4976-88a2-5870fa2ad8c4 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:54.042451 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-21adbddb-4bdf-4976-88a2-5870fa2ad8c4 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:54.042887 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-21adbddb-4bdf-4976-88a2-5870fa2ad8c4 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:54.043581 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-21adbddb-4bdf-4976-88a2-5870fa2ad8c4 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:54.044029 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-21adbddb-4bdf-4976-88a2-5870fa2ad8c4 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:54.044446 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-21adbddb-4bdf-4976-88a2-5870fa2ad8c4 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:54.091695 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-7dc0f8e9-ee43-4f06-86cb-f7ba7931d11c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:54.100051 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-7dc0f8e9-ee43-4f06-86cb-f7ba7931d11c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1757 microversion: 2.1 time: 0.173657 Aug 09 18:57:54.100654 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 513/995] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:53 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:57:54.113966 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-33d3ff5a-df01-446b-a289-9aa88f55254a tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:54.113966 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-33d3ff5a-df01-446b-a289-9aa88f55254a tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 77c72fb6-9a7c-43e4-9849-3eb79380b31b] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:54.113966 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-33d3ff5a-df01-446b-a289-9aa88f55254a tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:54.113966 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-33d3ff5a-df01-446b-a289-9aa88f55254a tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:54.114392 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-33d3ff5a-df01-446b-a289-9aa88f55254a tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:54.114596 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-33d3ff5a-df01-446b-a289-9aa88f55254a tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:54.115051 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-33d3ff5a-df01-446b-a289-9aa88f55254a tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:54.115484 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-33d3ff5a-df01-446b-a289-9aa88f55254a tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:54.209243 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-21adbddb-4bdf-4976-88a2-5870fa2ad8c4 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'debdf689e44c48e1bca1c7ad37f8335f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6338088b03415aa67ca34647ca0700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:54.218148 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-21adbddb-4bdf-4976-88a2-5870fa2ad8c4 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a47886-efa7-4829-892c-66f1002433f6" status: 200 len: 1313 microversion: 2.1 time: 0.187817 Aug 09 18:57:54.218586 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 483/996] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:54 2022] GET /compute/v2.1/servers/f5a47886-efa7-4829-892c-66f1002433f6 => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:57:54.257862 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-33d3ff5a-df01-446b-a289-9aa88f55254a tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:54.265914 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-33d3ff5a-df01-446b-a289-9aa88f55254a tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b" status: 200 len: 1319 microversion: 2.1 time: 0.164011 Aug 09 18:57:54.266622 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 514/997] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:54 2022] GET /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:57:55.124450 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-97a25124-59b9-4d47-adfe-69be2af9b97f tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:55.125044 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-97a25124-59b9-4d47-adfe-69be2af9b97f tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:55.131652 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-97a25124-59b9-4d47-adfe-69be2af9b97f tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:55.132133 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-97a25124-59b9-4d47-adfe-69be2af9b97f tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:55.132650 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-97a25124-59b9-4d47-adfe-69be2af9b97f tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:55.134082 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-97a25124-59b9-4d47-adfe-69be2af9b97f tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:55.134561 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-97a25124-59b9-4d47-adfe-69be2af9b97f tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:55.134993 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-97a25124-59b9-4d47-adfe-69be2af9b97f tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:55.239508 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-2a606ef4-18db-4700-bdec-3fe2dd756126 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:55.240097 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-2a606ef4-18db-4700-bdec-3fe2dd756126 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: f5a47886-efa7-4829-892c-66f1002433f6] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:55.247214 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2a606ef4-18db-4700-bdec-3fe2dd756126 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:55.248346 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2a606ef4-18db-4700-bdec-3fe2dd756126 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:55.248790 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2a606ef4-18db-4700-bdec-3fe2dd756126 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:55.249505 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2a606ef4-18db-4700-bdec-3fe2dd756126 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:55.251120 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2a606ef4-18db-4700-bdec-3fe2dd756126 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:55.251896 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2a606ef4-18db-4700-bdec-3fe2dd756126 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:55.286270 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-97a25124-59b9-4d47-adfe-69be2af9b97f tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:55.294577 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-97a25124-59b9-4d47-adfe-69be2af9b97f tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1757 microversion: 2.1 time: 0.174158 Aug 09 18:57:55.295146 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 484/998] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:55 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:57:55.299744 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-3c1010ef-adf1-4ce8-83ed-42b518f5a4b7 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:55.300341 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-3c1010ef-adf1-4ce8-83ed-42b518f5a4b7 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 77c72fb6-9a7c-43e4-9849-3eb79380b31b] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:55.307092 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3c1010ef-adf1-4ce8-83ed-42b518f5a4b7 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:55.307588 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3c1010ef-adf1-4ce8-83ed-42b518f5a4b7 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:55.308003 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3c1010ef-adf1-4ce8-83ed-42b518f5a4b7 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:55.308693 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3c1010ef-adf1-4ce8-83ed-42b518f5a4b7 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:55.309136 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3c1010ef-adf1-4ce8-83ed-42b518f5a4b7 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:55.309575 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3c1010ef-adf1-4ce8-83ed-42b518f5a4b7 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:55.403376 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-2a606ef4-18db-4700-bdec-3fe2dd756126 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'debdf689e44c48e1bca1c7ad37f8335f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6338088b03415aa67ca34647ca0700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:55.411990 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-2a606ef4-18db-4700-bdec-3fe2dd756126 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a47886-efa7-4829-892c-66f1002433f6" status: 200 len: 1313 microversion: 2.1 time: 0.176296 Aug 09 18:57:55.412583 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 515/999] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:55 2022] GET /compute/v2.1/servers/f5a47886-efa7-4829-892c-66f1002433f6 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:57:55.451657 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-3c1010ef-adf1-4ce8-83ed-42b518f5a4b7 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:55.454143 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-3c1010ef-adf1-4ce8-83ed-42b518f5a4b7 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b" status: 200 len: 1319 microversion: 2.1 time: 0.158041 Aug 09 18:57:55.454725 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 485/1000] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:55 2022] GET /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:57:56.316632 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-6445bec3-6793-44cf-8943-9ebaae7d94d5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:56.317284 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-6445bec3-6793-44cf-8943-9ebaae7d94d5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:56.324107 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6445bec3-6793-44cf-8943-9ebaae7d94d5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:56.324594 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6445bec3-6793-44cf-8943-9ebaae7d94d5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:56.325038 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6445bec3-6793-44cf-8943-9ebaae7d94d5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:56.325784 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6445bec3-6793-44cf-8943-9ebaae7d94d5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:56.326241 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6445bec3-6793-44cf-8943-9ebaae7d94d5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:56.326669 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6445bec3-6793-44cf-8943-9ebaae7d94d5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:56.432415 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-b18ddf75-0770-41cf-85d9-5f34988e66a5 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:56.433028 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-b18ddf75-0770-41cf-85d9-5f34988e66a5 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: f5a47886-efa7-4829-892c-66f1002433f6] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:56.439774 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b18ddf75-0770-41cf-85d9-5f34988e66a5 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:56.440255 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b18ddf75-0770-41cf-85d9-5f34988e66a5 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:56.440691 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b18ddf75-0770-41cf-85d9-5f34988e66a5 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:56.441382 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b18ddf75-0770-41cf-85d9-5f34988e66a5 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:56.441902 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b18ddf75-0770-41cf-85d9-5f34988e66a5 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:56.442324 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b18ddf75-0770-41cf-85d9-5f34988e66a5 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:56.477485 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-6445bec3-6793-44cf-8943-9ebaae7d94d5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:56.485471 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-6445bec3-6793-44cf-8943-9ebaae7d94d5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1757 microversion: 2.1 time: 0.173092 Aug 09 18:57:56.486089 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 516/1001] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:56 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:57:56.490669 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5de5dcd5-cde2-4592-ac18-1da3638b07f4 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:56.491270 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-5de5dcd5-cde2-4592-ac18-1da3638b07f4 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 77c72fb6-9a7c-43e4-9849-3eb79380b31b] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:56.497161 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5de5dcd5-cde2-4592-ac18-1da3638b07f4 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:56.497683 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5de5dcd5-cde2-4592-ac18-1da3638b07f4 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:56.498130 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5de5dcd5-cde2-4592-ac18-1da3638b07f4 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:56.498820 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5de5dcd5-cde2-4592-ac18-1da3638b07f4 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:56.499520 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5de5dcd5-cde2-4592-ac18-1da3638b07f4 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:56.499905 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5de5dcd5-cde2-4592-ac18-1da3638b07f4 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:56.575178 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-b18ddf75-0770-41cf-85d9-5f34988e66a5 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'debdf689e44c48e1bca1c7ad37f8335f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6338088b03415aa67ca34647ca0700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:56.582710 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-b18ddf75-0770-41cf-85d9-5f34988e66a5 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a47886-efa7-4829-892c-66f1002433f6" status: 200 len: 1313 microversion: 2.1 time: 0.154392 Aug 09 18:57:56.583284 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 486/1002] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:56 2022] GET /compute/v2.1/servers/f5a47886-efa7-4829-892c-66f1002433f6 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:57:56.635425 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5de5dcd5-cde2-4592-ac18-1da3638b07f4 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:56.642983 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-5de5dcd5-cde2-4592-ac18-1da3638b07f4 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b" status: 200 len: 1319 microversion: 2.1 time: 0.155902 Aug 09 18:57:56.643557 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 517/1003] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:56 2022] GET /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:57:57.506702 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-e1552e54-95e2-43d7-89cc-1bc60fcb8355 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:57.508898 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-e1552e54-95e2-43d7-89cc-1bc60fcb8355 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:57.510502 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:57:57.515194 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e1552e54-95e2-43d7-89cc-1bc60fcb8355 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:57.515673 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e1552e54-95e2-43d7-89cc-1bc60fcb8355 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:57.516102 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e1552e54-95e2-43d7-89cc-1bc60fcb8355 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:57.516792 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e1552e54-95e2-43d7-89cc-1bc60fcb8355 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:57.517239 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e1552e54-95e2-43d7-89cc-1bc60fcb8355 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:57.517696 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e1552e54-95e2-43d7-89cc-1bc60fcb8355 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:57.605205 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e7fdb975-93f1-4e1d-b72e-9c327b3b37bc tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:57.605987 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e7fdb975-93f1-4e1d-b72e-9c327b3b37bc tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: f5a47886-efa7-4829-892c-66f1002433f6] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:57.612504 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e7fdb975-93f1-4e1d-b72e-9c327b3b37bc tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:57.613013 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e7fdb975-93f1-4e1d-b72e-9c327b3b37bc tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:57.613559 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e7fdb975-93f1-4e1d-b72e-9c327b3b37bc tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:57.614273 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e7fdb975-93f1-4e1d-b72e-9c327b3b37bc tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:57.614944 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e7fdb975-93f1-4e1d-b72e-9c327b3b37bc tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:57.615370 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e7fdb975-93f1-4e1d-b72e-9c327b3b37bc tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:57.723180 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-e1552e54-95e2-43d7-89cc-1bc60fcb8355 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:57.737393 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-e1552e54-95e2-43d7-89cc-1bc60fcb8355 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1757 microversion: 2.1 time: 0.234320 Aug 09 18:57:57.738537 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 487/1004] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:57 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1757 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:57:57.757900 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-78d93754-0c49-4f67-8c63-0b2344ef19ba tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:57.758610 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-78d93754-0c49-4f67-8c63-0b2344ef19ba tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 77c72fb6-9a7c-43e4-9849-3eb79380b31b] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:57.764928 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-78d93754-0c49-4f67-8c63-0b2344ef19ba tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:57.765766 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-78d93754-0c49-4f67-8c63-0b2344ef19ba tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:57.766014 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-78d93754-0c49-4f67-8c63-0b2344ef19ba tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:57.772011 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-78d93754-0c49-4f67-8c63-0b2344ef19ba tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:57.772011 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-78d93754-0c49-4f67-8c63-0b2344ef19ba tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:57.772011 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-78d93754-0c49-4f67-8c63-0b2344ef19ba tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:57.772011 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell1:SELECT=100 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:57:57.811135 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e7fdb975-93f1-4e1d-b72e-9c327b3b37bc tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'debdf689e44c48e1bca1c7ad37f8335f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6338088b03415aa67ca34647ca0700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:57.823263 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e7fdb975-93f1-4e1d-b72e-9c327b3b37bc tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a47886-efa7-4829-892c-66f1002433f6" status: 200 len: 1313 microversion: 2.1 time: 0.222728 Aug 09 18:57:57.824172 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 518/1005] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:57 2022] GET /compute/v2.1/servers/f5a47886-efa7-4829-892c-66f1002433f6 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:57:57.828966 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-2cd1bda0-f978-4fbb-88d4-bc1ffedd9dc5 req-1ebcca3d-afde-4327-aa27-8547d07726d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5a47886-efa7-4829-892c-66f1002433f6", "tag": "18581288-e19d-4cd8-b368-4f0ea22bb960"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:57:57.846389 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-2cd1bda0-f978-4fbb-88d4-bc1ffedd9dc5 req-1ebcca3d-afde-4327-aa27-8547d07726d0 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:57.847673 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-2cd1bda0-f978-4fbb-88d4-bc1ffedd9dc5 req-1ebcca3d-afde-4327-aa27-8547d07726d0 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:57.848102 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-2cd1bda0-f978-4fbb-88d4-bc1ffedd9dc5 req-1ebcca3d-afde-4327-aa27-8547d07726d0 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:57.863052 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-2cd1bda0-f978-4fbb-88d4-bc1ffedd9dc5 req-1ebcca3d-afde-4327-aa27-8547d07726d0 service nova] Creating event network-changed:18581288-e19d-4cd8-b368-4f0ea22bb960 for instance f5a47886-efa7-4829-892c-66f1002433f6 on hv-cinder-82660 Aug 09 18:57:57.869721 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-2cd1bda0-f978-4fbb-88d4-bc1ffedd9dc5 req-1ebcca3d-afde-4327-aa27-8547d07726d0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044142 Aug 09 18:57:57.870355 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 519/1006] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:57:58.018845 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-78d93754-0c49-4f67-8c63-0b2344ef19ba tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:58.028622 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-78d93754-0c49-4f67-8c63-0b2344ef19ba tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b" status: 200 len: 1319 microversion: 2.1 time: 0.274267 Aug 09 18:57:58.029891 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 488/1007] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:57 2022] GET /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b => generated 1319 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:57:58.765028 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-83d96a5c-f949-45c9-ac93-3c21f1dbb78d tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:58.765741 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-83d96a5c-f949-45c9-ac93-3c21f1dbb78d tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:58.772485 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-83d96a5c-f949-45c9-ac93-3c21f1dbb78d tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:58.772969 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-83d96a5c-f949-45c9-ac93-3c21f1dbb78d tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:58.774134 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-83d96a5c-f949-45c9-ac93-3c21f1dbb78d tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:58.774832 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-83d96a5c-f949-45c9-ac93-3c21f1dbb78d tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:58.775319 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-83d96a5c-f949-45c9-ac93-3c21f1dbb78d tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:58.775771 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-83d96a5c-f949-45c9-ac93-3c21f1dbb78d tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:58.843400 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-9c40823d-5acf-4d33-9475-759c0dde8ebd tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:58.844006 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-9c40823d-5acf-4d33-9475-759c0dde8ebd tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: f5a47886-efa7-4829-892c-66f1002433f6] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:58.850539 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9c40823d-5acf-4d33-9475-759c0dde8ebd tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:58.851028 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9c40823d-5acf-4d33-9475-759c0dde8ebd tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:58.851515 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9c40823d-5acf-4d33-9475-759c0dde8ebd tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:58.852580 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9c40823d-5acf-4d33-9475-759c0dde8ebd tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:58.852686 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9c40823d-5acf-4d33-9475-759c0dde8ebd tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:58.853041 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9c40823d-5acf-4d33-9475-759c0dde8ebd tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:58.927915 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-83d96a5c-f949-45c9-ac93-3c21f1dbb78d tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:58.932280 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=100 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:57:58.937541 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-83d96a5c-f949-45c9-ac93-3c21f1dbb78d tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1760 microversion: 2.1 time: 0.177053 Aug 09 18:57:58.938422 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 520/1008] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:58 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1760 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:57:59.005484 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-9c40823d-5acf-4d33-9475-759c0dde8ebd tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'debdf689e44c48e1bca1c7ad37f8335f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6338088b03415aa67ca34647ca0700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:59.013518 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-9c40823d-5acf-4d33-9475-759c0dde8ebd tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a47886-efa7-4829-892c-66f1002433f6" status: 200 len: 1313 microversion: 2.1 time: 0.173988 Aug 09 18:57:59.014098 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 489/1009] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:58 2022] GET /compute/v2.1/servers/f5a47886-efa7-4829-892c-66f1002433f6 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:57:59.052220 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-dceb46ec-fe56-4b17-9f7e-660a3c88f371 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:57:59.052850 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-dceb46ec-fe56-4b17-9f7e-660a3c88f371 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 77c72fb6-9a7c-43e4-9849-3eb79380b31b] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:57:59.059879 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dceb46ec-fe56-4b17-9f7e-660a3c88f371 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:59.060366 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dceb46ec-fe56-4b17-9f7e-660a3c88f371 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:59.060807 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dceb46ec-fe56-4b17-9f7e-660a3c88f371 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:59.061493 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dceb46ec-fe56-4b17-9f7e-660a3c88f371 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:57:59.062062 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dceb46ec-fe56-4b17-9f7e-660a3c88f371 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:57:59.062480 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dceb46ec-fe56-4b17-9f7e-660a3c88f371 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:57:59.191438 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-dceb46ec-fe56-4b17-9f7e-660a3c88f371 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:57:59.199439 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-dceb46ec-fe56-4b17-9f7e-660a3c88f371 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b" status: 200 len: 1319 microversion: 2.1 time: 0.151119 Aug 09 18:57:59.200020 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 521/1010] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:57:59 2022] GET /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:58:00.034031 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-a04a5d7d-4e10-415b-96ed-0cf60ffafc71 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:58:00.034666 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-a04a5d7d-4e10-415b-96ed-0cf60ffafc71 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: f5a47886-efa7-4829-892c-66f1002433f6] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:58:00.041068 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a04a5d7d-4e10-415b-96ed-0cf60ffafc71 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:00.041569 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a04a5d7d-4e10-415b-96ed-0cf60ffafc71 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:00.042008 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a04a5d7d-4e10-415b-96ed-0cf60ffafc71 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:00.042703 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a04a5d7d-4e10-415b-96ed-0cf60ffafc71 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:00.043156 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a04a5d7d-4e10-415b-96ed-0cf60ffafc71 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:00.043577 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a04a5d7d-4e10-415b-96ed-0cf60ffafc71 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:00.181684 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-a04a5d7d-4e10-415b-96ed-0cf60ffafc71 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'debdf689e44c48e1bca1c7ad37f8335f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6338088b03415aa67ca34647ca0700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:58:00.189415 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-a04a5d7d-4e10-415b-96ed-0cf60ffafc71 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a47886-efa7-4829-892c-66f1002433f6" status: 200 len: 1313 microversion: 2.1 time: 0.159348 Aug 09 18:58:00.190019 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 490/1011] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:58:00 2022] GET /compute/v2.1/servers/f5a47886-efa7-4829-892c-66f1002433f6 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:58:00.220013 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b8663830-e956-45b4-9edc-2eece60ebe7a tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:58:00.220635 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-b8663830-e956-45b4-9edc-2eece60ebe7a tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 77c72fb6-9a7c-43e4-9849-3eb79380b31b] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:58:00.222938 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=4 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:58:00.223587 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=12 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:58:00.228457 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b8663830-e956-45b4-9edc-2eece60ebe7a tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:00.228930 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b8663830-e956-45b4-9edc-2eece60ebe7a tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:00.229353 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b8663830-e956-45b4-9edc-2eece60ebe7a tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:00.230073 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b8663830-e956-45b4-9edc-2eece60ebe7a tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:00.230519 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b8663830-e956-45b4-9edc-2eece60ebe7a tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:00.230934 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b8663830-e956-45b4-9edc-2eece60ebe7a tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:00.360185 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-b8663830-e956-45b4-9edc-2eece60ebe7a tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:58:00.368224 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-b8663830-e956-45b4-9edc-2eece60ebe7a tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b" status: 200 len: 1319 microversion: 2.1 time: 0.152066 Aug 09 18:58:00.368801 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 522/1012] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:58:00 2022] GET /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:58:01.211729 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-06dc9212-1c60-4f50-af0d-34e7f1540e88 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:58:01.213129 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-06dc9212-1c60-4f50-af0d-34e7f1540e88 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: f5a47886-efa7-4829-892c-66f1002433f6] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:58:01.215364 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell0:SELECT=4 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:58:01.221414 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-06dc9212-1c60-4f50-af0d-34e7f1540e88 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:01.226499 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-06dc9212-1c60-4f50-af0d-34e7f1540e88 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:01.226499 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-06dc9212-1c60-4f50-af0d-34e7f1540e88 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:01.226499 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-06dc9212-1c60-4f50-af0d-34e7f1540e88 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:01.226499 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-06dc9212-1c60-4f50-af0d-34e7f1540e88 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:01.227466 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-06dc9212-1c60-4f50-af0d-34e7f1540e88 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:01.389405 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-0431b862-8454-4059-8872-f0a0e5522106 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:58:01.390233 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-0431b862-8454-4059-8872-f0a0e5522106 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 77c72fb6-9a7c-43e4-9849-3eb79380b31b] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:58:01.397488 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0431b862-8454-4059-8872-f0a0e5522106 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:01.407005 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0431b862-8454-4059-8872-f0a0e5522106 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:01.407005 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0431b862-8454-4059-8872-f0a0e5522106 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:01.407005 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0431b862-8454-4059-8872-f0a0e5522106 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:01.407005 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0431b862-8454-4059-8872-f0a0e5522106 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:01.407433 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0431b862-8454-4059-8872-f0a0e5522106 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:01.516097 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-06dc9212-1c60-4f50-af0d-34e7f1540e88 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'debdf689e44c48e1bca1c7ad37f8335f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6338088b03415aa67ca34647ca0700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:58:01.523971 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-06dc9212-1c60-4f50-af0d-34e7f1540e88 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a47886-efa7-4829-892c-66f1002433f6" status: 200 len: 1313 microversion: 2.1 time: 0.316278 Aug 09 18:58:01.537436 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 491/1013] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:58:01 2022] GET /compute/v2.1/servers/f5a47886-efa7-4829-892c-66f1002433f6 => generated 1313 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:58:01.547166 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-0431b862-8454-4059-8872-f0a0e5522106 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:58:01.556355 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-0431b862-8454-4059-8872-f0a0e5522106 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b" status: 200 len: 1319 microversion: 2.1 time: 0.170626 Aug 09 18:58:01.556900 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 523/1014] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:58:01 2022] GET /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:58:02.545002 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-44dd63a5-5147-44b6-8a28-12f646b9ef31 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:58:02.545657 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-44dd63a5-5147-44b6-8a28-12f646b9ef31 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: f5a47886-efa7-4829-892c-66f1002433f6] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:58:02.552297 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-44dd63a5-5147-44b6-8a28-12f646b9ef31 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:02.552790 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-44dd63a5-5147-44b6-8a28-12f646b9ef31 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:02.553220 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-44dd63a5-5147-44b6-8a28-12f646b9ef31 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:02.553959 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-44dd63a5-5147-44b6-8a28-12f646b9ef31 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:02.554989 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-44dd63a5-5147-44b6-8a28-12f646b9ef31 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:02.555430 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-44dd63a5-5147-44b6-8a28-12f646b9ef31 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:02.578484 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-cf60e517-f670-4df2-b6a3-41bbd0f3a817 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:58:02.579119 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-cf60e517-f670-4df2-b6a3-41bbd0f3a817 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 77c72fb6-9a7c-43e4-9849-3eb79380b31b] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:58:02.587398 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cf60e517-f670-4df2-b6a3-41bbd0f3a817 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:02.588213 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cf60e517-f670-4df2-b6a3-41bbd0f3a817 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:02.588667 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cf60e517-f670-4df2-b6a3-41bbd0f3a817 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:02.589394 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cf60e517-f670-4df2-b6a3-41bbd0f3a817 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:02.589876 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cf60e517-f670-4df2-b6a3-41bbd0f3a817 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:02.590318 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cf60e517-f670-4df2-b6a3-41bbd0f3a817 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:02.699525 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-44dd63a5-5147-44b6-8a28-12f646b9ef31 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'debdf689e44c48e1bca1c7ad37f8335f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6338088b03415aa67ca34647ca0700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:58:02.704427 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-44dd63a5-5147-44b6-8a28-12f646b9ef31 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a47886-efa7-4829-892c-66f1002433f6" status: 200 len: 1313 microversion: 2.1 time: 0.163389 Aug 09 18:58:02.705018 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 492/1015] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:58:02 2022] GET /compute/v2.1/servers/f5a47886-efa7-4829-892c-66f1002433f6 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:58:02.732803 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-cf60e517-f670-4df2-b6a3-41bbd0f3a817 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:58:02.740439 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-cf60e517-f670-4df2-b6a3-41bbd0f3a817 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b" status: 200 len: 1319 microversion: 2.1 time: 0.166104 Aug 09 18:58:02.741018 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 524/1016] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:58:02 2022] GET /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:58:03.269282 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-90f4d627-36f3-4738-9533-629343ff6626 req-4dea3f35-4e67-4995-88b4-f7bc14ef8fad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77c72fb6-9a7c-43e4-9849-3eb79380b31b", "name": "network-vif-plugged", "status": "completed", "tag": "e40ff188-6781-440f-90b6-a548ddce22f8"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:58:03.280469 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-90f4d627-36f3-4738-9533-629343ff6626 req-4dea3f35-4e67-4995-88b4-f7bc14ef8fad service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:03.281137 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-90f4d627-36f3-4738-9533-629343ff6626 req-4dea3f35-4e67-4995-88b4-f7bc14ef8fad service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:03.281663 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-90f4d627-36f3-4738-9533-629343ff6626 req-4dea3f35-4e67-4995-88b4-f7bc14ef8fad service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:03.295272 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-90f4d627-36f3-4738-9533-629343ff6626 req-4dea3f35-4e67-4995-88b4-f7bc14ef8fad service nova] Creating event network-vif-plugged:e40ff188-6781-440f-90b6-a548ddce22f8 for instance 77c72fb6-9a7c-43e4-9849-3eb79380b31b on hv-cinder-82660 Aug 09 18:58:03.300791 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-90f4d627-36f3-4738-9533-629343ff6626 req-4dea3f35-4e67-4995-88b4-f7bc14ef8fad service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036601 Aug 09 18:58:03.301390 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 493/1017] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:58:03.727030 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-916e80c5-88c8-4f6f-9619-1d9ca33b3412 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:58:03.727669 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-916e80c5-88c8-4f6f-9619-1d9ca33b3412 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: f5a47886-efa7-4829-892c-66f1002433f6] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:58:03.734718 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-916e80c5-88c8-4f6f-9619-1d9ca33b3412 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:03.735495 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-916e80c5-88c8-4f6f-9619-1d9ca33b3412 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:03.736294 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-916e80c5-88c8-4f6f-9619-1d9ca33b3412 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:03.736548 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-916e80c5-88c8-4f6f-9619-1d9ca33b3412 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:03.737012 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-916e80c5-88c8-4f6f-9619-1d9ca33b3412 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:03.738120 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-916e80c5-88c8-4f6f-9619-1d9ca33b3412 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:03.761177 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-6cee3604-b31f-4d0a-b0bd-ffbd59e328ff tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:58:03.761943 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-6cee3604-b31f-4d0a-b0bd-ffbd59e328ff tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 77c72fb6-9a7c-43e4-9849-3eb79380b31b] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:58:03.768747 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6cee3604-b31f-4d0a-b0bd-ffbd59e328ff tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:03.769243 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6cee3604-b31f-4d0a-b0bd-ffbd59e328ff tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:03.769805 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6cee3604-b31f-4d0a-b0bd-ffbd59e328ff tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:03.770506 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6cee3604-b31f-4d0a-b0bd-ffbd59e328ff tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:03.770981 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6cee3604-b31f-4d0a-b0bd-ffbd59e328ff tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:03.771530 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6cee3604-b31f-4d0a-b0bd-ffbd59e328ff tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:03.882075 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-916e80c5-88c8-4f6f-9619-1d9ca33b3412 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'debdf689e44c48e1bca1c7ad37f8335f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6338088b03415aa67ca34647ca0700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:58:03.890321 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-916e80c5-88c8-4f6f-9619-1d9ca33b3412 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a47886-efa7-4829-892c-66f1002433f6" status: 200 len: 1313 microversion: 2.1 time: 0.167572 Aug 09 18:58:03.904399 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 525/1018] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:58:03 2022] GET /compute/v2.1/servers/f5a47886-efa7-4829-892c-66f1002433f6 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:58:03.908195 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-6cee3604-b31f-4d0a-b0bd-ffbd59e328ff tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:58:03.916705 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-6cee3604-b31f-4d0a-b0bd-ffbd59e328ff tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b" status: 200 len: 1319 microversion: 2.1 time: 0.159943 Aug 09 18:58:03.919828 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 494/1019] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:58:03 2022] GET /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:58:04.912049 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-7f95ba24-f482-497a-aece-d3b8b5834784 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:58:04.915996 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-7f95ba24-f482-497a-aece-d3b8b5834784 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: f5a47886-efa7-4829-892c-66f1002433f6] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:58:04.920237 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7f95ba24-f482-497a-aece-d3b8b5834784 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:04.920724 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7f95ba24-f482-497a-aece-d3b8b5834784 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:04.921151 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7f95ba24-f482-497a-aece-d3b8b5834784 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:04.921879 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7f95ba24-f482-497a-aece-d3b8b5834784 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:04.922545 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7f95ba24-f482-497a-aece-d3b8b5834784 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:04.923041 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7f95ba24-f482-497a-aece-d3b8b5834784 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:04.939630 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-d43ec5d6-051f-4593-bd4c-b69dfb02fddf tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:58:04.940444 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-d43ec5d6-051f-4593-bd4c-b69dfb02fddf tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 77c72fb6-9a7c-43e4-9849-3eb79380b31b] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:58:04.947365 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d43ec5d6-051f-4593-bd4c-b69dfb02fddf tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:04.948140 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d43ec5d6-051f-4593-bd4c-b69dfb02fddf tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:04.948645 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d43ec5d6-051f-4593-bd4c-b69dfb02fddf tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:04.949966 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d43ec5d6-051f-4593-bd4c-b69dfb02fddf tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:04.950433 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d43ec5d6-051f-4593-bd4c-b69dfb02fddf tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:04.950858 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d43ec5d6-051f-4593-bd4c-b69dfb02fddf tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:05.070973 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-7f95ba24-f482-497a-aece-d3b8b5834784 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'debdf689e44c48e1bca1c7ad37f8335f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6338088b03415aa67ca34647ca0700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:58:05.077563 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-7f95ba24-f482-497a-aece-d3b8b5834784 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a47886-efa7-4829-892c-66f1002433f6" status: 200 len: 1313 microversion: 2.1 time: 0.169349 Aug 09 18:58:05.078168 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 526/1020] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:58:04 2022] GET /compute/v2.1/servers/f5a47886-efa7-4829-892c-66f1002433f6 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:58:05.108865 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-d43ec5d6-051f-4593-bd4c-b69dfb02fddf tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:58:05.116907 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-d43ec5d6-051f-4593-bd4c-b69dfb02fddf tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b" status: 200 len: 1508 microversion: 2.1 time: 0.182224 Aug 09 18:58:05.117537 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 495/1021] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:58:04 2022] GET /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b => generated 1508 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:58:05.144400 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-1a438aaf-7444-4dfc-8164-19e02709e395 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67149fd3-6f2f-4773-a4d1-b1c344a5a8af", "device": "/dev/sdb"}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:58:05.147361 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-1a438aaf-7444-4dfc-8164-19e02709e395 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 77c72fb6-9a7c-43e4-9849-3eb79380b31b] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:58:05.153932 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1a438aaf-7444-4dfc-8164-19e02709e395 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:05.155108 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1a438aaf-7444-4dfc-8164-19e02709e395 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:05.155108 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1a438aaf-7444-4dfc-8164-19e02709e395 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:05.155697 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1a438aaf-7444-4dfc-8164-19e02709e395 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:05.156331 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1a438aaf-7444-4dfc-8164-19e02709e395 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:05.156749 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1a438aaf-7444-4dfc-8164-19e02709e395 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:05.318070 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-daef5002-7ca0-49d6-a6af-ff7e131c9922 req-d6c72e1f-2cdb-4188-9322-8c40fa5d66dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5a47886-efa7-4829-892c-66f1002433f6", "name": "network-vif-plugged", "status": "completed", "tag": "18581288-e19d-4cd8-b368-4f0ea22bb960"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:58:05.328609 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-daef5002-7ca0-49d6-a6af-ff7e131c9922 req-d6c72e1f-2cdb-4188-9322-8c40fa5d66dd service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:05.329711 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-daef5002-7ca0-49d6-a6af-ff7e131c9922 req-d6c72e1f-2cdb-4188-9322-8c40fa5d66dd service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:05.329711 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-daef5002-7ca0-49d6-a6af-ff7e131c9922 req-d6c72e1f-2cdb-4188-9322-8c40fa5d66dd service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:05.342110 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-daef5002-7ca0-49d6-a6af-ff7e131c9922 req-d6c72e1f-2cdb-4188-9322-8c40fa5d66dd service nova] Creating event network-vif-plugged:18581288-e19d-4cd8-b368-4f0ea22bb960 for instance f5a47886-efa7-4829-892c-66f1002433f6 on hv-cinder-82660 Aug 09 18:58:05.356518 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-daef5002-7ca0-49d6-a6af-ff7e131c9922 req-d6c72e1f-2cdb-4188-9322-8c40fa5d66dd service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043453 Aug 09 18:58:05.357040 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 496/1022] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:58:06.035016 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-1a438aaf-7444-4dfc-8164-19e02709e395 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "POST /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.899771 Aug 09 18:58:06.035585 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 527/1023] 10.222.0.57 () {60 vars in 1323 bytes} [Tue Aug 9 18:58:05 2022] POST /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b/os-volume_attachments => generated 194 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:58:06.100091 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-7023092a-17e4-4f74-b04b-9cfabb6ab074 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:58:06.100815 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-7023092a-17e4-4f74-b04b-9cfabb6ab074 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: f5a47886-efa7-4829-892c-66f1002433f6] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:58:06.107486 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7023092a-17e4-4f74-b04b-9cfabb6ab074 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:06.107999 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7023092a-17e4-4f74-b04b-9cfabb6ab074 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:06.108397 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7023092a-17e4-4f74-b04b-9cfabb6ab074 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:06.109156 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7023092a-17e4-4f74-b04b-9cfabb6ab074 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:06.109592 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7023092a-17e4-4f74-b04b-9cfabb6ab074 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:06.110071 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7023092a-17e4-4f74-b04b-9cfabb6ab074 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:06.258213 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-7023092a-17e4-4f74-b04b-9cfabb6ab074 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'debdf689e44c48e1bca1c7ad37f8335f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6338088b03415aa67ca34647ca0700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:58:06.265822 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-7023092a-17e4-4f74-b04b-9cfabb6ab074 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a47886-efa7-4829-892c-66f1002433f6" status: 200 len: 1313 microversion: 2.1 time: 0.170334 Aug 09 18:58:06.266407 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 497/1024] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:58:06 2022] GET /compute/v2.1/servers/f5a47886-efa7-4829-892c-66f1002433f6 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:58:07.287690 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5c3a5c80-183c-4a17-b77d-30422352aa5f tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:58:07.288497 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-5c3a5c80-183c-4a17-b77d-30422352aa5f tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: f5a47886-efa7-4829-892c-66f1002433f6] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:58:07.294963 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5c3a5c80-183c-4a17-b77d-30422352aa5f tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:07.295450 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5c3a5c80-183c-4a17-b77d-30422352aa5f tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:07.295921 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5c3a5c80-183c-4a17-b77d-30422352aa5f tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:07.296658 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5c3a5c80-183c-4a17-b77d-30422352aa5f tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:07.297120 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5c3a5c80-183c-4a17-b77d-30422352aa5f tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:07.297563 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5c3a5c80-183c-4a17-b77d-30422352aa5f tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:07.436748 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5c3a5c80-183c-4a17-b77d-30422352aa5f tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'debdf689e44c48e1bca1c7ad37f8335f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6338088b03415aa67ca34647ca0700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:58:07.444744 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-5c3a5c80-183c-4a17-b77d-30422352aa5f tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a47886-efa7-4829-892c-66f1002433f6" status: 200 len: 1313 microversion: 2.1 time: 0.161910 Aug 09 18:58:07.445338 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 528/1025] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:58:07 2022] GET /compute/v2.1/servers/f5a47886-efa7-4829-892c-66f1002433f6 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:58:08.466131 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-0193b28b-03fd-48af-a0f8-df523bfe447b tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:58:08.466698 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-0193b28b-03fd-48af-a0f8-df523bfe447b tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: f5a47886-efa7-4829-892c-66f1002433f6] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:58:08.473326 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0193b28b-03fd-48af-a0f8-df523bfe447b tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:08.473892 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0193b28b-03fd-48af-a0f8-df523bfe447b tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:08.474300 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0193b28b-03fd-48af-a0f8-df523bfe447b tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:08.474985 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0193b28b-03fd-48af-a0f8-df523bfe447b tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:08.475431 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0193b28b-03fd-48af-a0f8-df523bfe447b tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:08.475848 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0193b28b-03fd-48af-a0f8-df523bfe447b tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:08.609133 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-0193b28b-03fd-48af-a0f8-df523bfe447b tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'debdf689e44c48e1bca1c7ad37f8335f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6338088b03415aa67ca34647ca0700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:58:08.616711 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-0193b28b-03fd-48af-a0f8-df523bfe447b tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a47886-efa7-4829-892c-66f1002433f6" status: 200 len: 1496 microversion: 2.1 time: 0.154490 Aug 09 18:58:08.617829 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 498/1026] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:58:08 2022] GET /compute/v2.1/servers/f5a47886-efa7-4829-892c-66f1002433f6 => generated 1496 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:58:10.739308 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-62c97d75-8131-4697-80ee-ae8f858de944 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:58:10.739890 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-62c97d75-8131-4697-80ee-ae8f858de944 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: f5a47886-efa7-4829-892c-66f1002433f6] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:58:10.748411 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-62c97d75-8131-4697-80ee-ae8f858de944 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:10.748905 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-62c97d75-8131-4697-80ee-ae8f858de944 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:10.749343 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-62c97d75-8131-4697-80ee-ae8f858de944 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:10.750082 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-62c97d75-8131-4697-80ee-ae8f858de944 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:10.750642 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-62c97d75-8131-4697-80ee-ae8f858de944 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:10.750965 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-62c97d75-8131-4697-80ee-ae8f858de944 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:10.777397 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-62c97d75-8131-4697-80ee-ae8f858de944 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: f5a47886-efa7-4829-892c-66f1002433f6] Going to try to terminate instance {{(pid=124725) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:58:11.259875 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-62c97d75-8131-4697-80ee-ae8f858de944 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f5a47886-efa7-4829-892c-66f1002433f6" status: 204 len: 0 microversion: 2.1 time: 0.524369 Aug 09 18:58:11.260706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 529/1027] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 9 18:58:10 2022] DELETE /compute/v2.1/servers/f5a47886-efa7-4829-892c-66f1002433f6 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:58:11.274104 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-65fbc11c-287b-46c2-af9b-aa9802fabde0 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:58:11.274104 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-65fbc11c-287b-46c2-af9b-aa9802fabde0 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: f5a47886-efa7-4829-892c-66f1002433f6] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:58:11.276801 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-65fbc11c-287b-46c2-af9b-aa9802fabde0 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:11.277289 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-65fbc11c-287b-46c2-af9b-aa9802fabde0 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:11.277761 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-65fbc11c-287b-46c2-af9b-aa9802fabde0 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:11.278460 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-65fbc11c-287b-46c2-af9b-aa9802fabde0 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:11.278922 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-65fbc11c-287b-46c2-af9b-aa9802fabde0 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:11.279407 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-65fbc11c-287b-46c2-af9b-aa9802fabde0 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:11.417496 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-65fbc11c-287b-46c2-af9b-aa9802fabde0 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'debdf689e44c48e1bca1c7ad37f8335f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6338088b03415aa67ca34647ca0700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:58:11.425138 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-65fbc11c-287b-46c2-af9b-aa9802fabde0 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a47886-efa7-4829-892c-66f1002433f6" status: 200 len: 1502 microversion: 2.1 time: 0.160041 Aug 09 18:58:11.425739 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 499/1028] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:58:11 2022] GET /compute/v2.1/servers/f5a47886-efa7-4829-892c-66f1002433f6 => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:58:12.449383 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-636291d5-3db9-4c64-8684-c939a1c17f24 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:58:12.450127 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-636291d5-3db9-4c64-8684-c939a1c17f24 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: f5a47886-efa7-4829-892c-66f1002433f6] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:58:12.463168 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-636291d5-3db9-4c64-8684-c939a1c17f24 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:12.463168 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-636291d5-3db9-4c64-8684-c939a1c17f24 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:12.463168 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-636291d5-3db9-4c64-8684-c939a1c17f24 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:12.463168 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-636291d5-3db9-4c64-8684-c939a1c17f24 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:12.463642 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-636291d5-3db9-4c64-8684-c939a1c17f24 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:12.463642 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-636291d5-3db9-4c64-8684-c939a1c17f24 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:12.592040 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-636291d5-3db9-4c64-8684-c939a1c17f24 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'debdf689e44c48e1bca1c7ad37f8335f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6338088b03415aa67ca34647ca0700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:58:12.599581 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-636291d5-3db9-4c64-8684-c939a1c17f24 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a47886-efa7-4829-892c-66f1002433f6" status: 200 len: 1502 microversion: 2.1 time: 0.155016 Aug 09 18:58:12.600157 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 530/1029] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:58:12 2022] GET /compute/v2.1/servers/f5a47886-efa7-4829-892c-66f1002433f6 => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:58:13.621108 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-3803b333-3010-410e-af5d-64de4f993a00 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:58:13.621748 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-3803b333-3010-410e-af5d-64de4f993a00 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: f5a47886-efa7-4829-892c-66f1002433f6] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:58:13.628047 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3803b333-3010-410e-af5d-64de4f993a00 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:13.628536 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3803b333-3010-410e-af5d-64de4f993a00 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:13.628976 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3803b333-3010-410e-af5d-64de4f993a00 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:13.629707 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3803b333-3010-410e-af5d-64de4f993a00 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:13.630161 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3803b333-3010-410e-af5d-64de4f993a00 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:13.630584 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3803b333-3010-410e-af5d-64de4f993a00 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:13.710694 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-3803b333-3010-410e-af5d-64de4f993a00 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'debdf689e44c48e1bca1c7ad37f8335f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6338088b03415aa67ca34647ca0700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:58:13.724937 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-3803b333-3010-410e-af5d-64de4f993a00 tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a47886-efa7-4829-892c-66f1002433f6" status: 200 len: 1460 microversion: 2.1 time: 0.107983 Aug 09 18:58:13.729401 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 500/1030] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:58:13 2022] GET /compute/v2.1/servers/f5a47886-efa7-4829-892c-66f1002433f6 => generated 1460 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:58:13.798662 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-9755fbff-f0db-47bd-ae01-e1d8910fea92 req-241d706f-2ce9-4afb-b476-71cf832b89b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5a47886-efa7-4829-892c-66f1002433f6", "name": "network-vif-deleted", "tag": "18581288-e19d-4cd8-b368-4f0ea22bb960"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:58:13.810077 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-9755fbff-f0db-47bd-ae01-e1d8910fea92 req-241d706f-2ce9-4afb-b476-71cf832b89b2 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:13.810554 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-9755fbff-f0db-47bd-ae01-e1d8910fea92 req-241d706f-2ce9-4afb-b476-71cf832b89b2 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:13.811072 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-9755fbff-f0db-47bd-ae01-e1d8910fea92 req-241d706f-2ce9-4afb-b476-71cf832b89b2 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:13.824342 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-9755fbff-f0db-47bd-ae01-e1d8910fea92 req-241d706f-2ce9-4afb-b476-71cf832b89b2 service nova] Creating event network-vif-deleted:18581288-e19d-4cd8-b368-4f0ea22bb960 for instance f5a47886-efa7-4829-892c-66f1002433f6 on hv-cinder-82660 Aug 09 18:58:13.829499 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-9755fbff-f0db-47bd-ae01-e1d8910fea92 req-241d706f-2ce9-4afb-b476-71cf832b89b2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034439 Aug 09 18:58:13.830134 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 531/1031] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:58:14.752649 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-1e6133fe-aea0-4c1c-8402-a97b6d5f930a tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:58:14.753411 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-1e6133fe-aea0-4c1c-8402-a97b6d5f930a tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: f5a47886-efa7-4829-892c-66f1002433f6] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:58:14.759732 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1e6133fe-aea0-4c1c-8402-a97b6d5f930a tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:14.761069 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1e6133fe-aea0-4c1c-8402-a97b6d5f930a tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:14.761069 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1e6133fe-aea0-4c1c-8402-a97b6d5f930a tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:14.761461 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1e6133fe-aea0-4c1c-8402-a97b6d5f930a tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:14.761964 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1e6133fe-aea0-4c1c-8402-a97b6d5f930a tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:14.762391 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1e6133fe-aea0-4c1c-8402-a97b6d5f930a tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:14.798915 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1e6133fe-aea0-4c1c-8402-a97b6d5f930a tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:14.798915 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1e6133fe-aea0-4c1c-8402-a97b6d5f930a tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:14.798915 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1e6133fe-aea0-4c1c-8402-a97b6d5f930a tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:14.798915 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.objects.instance [None req-1e6133fe-aea0-4c1c-8402-a97b6d5f930a tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lazy-loading 'fault' on Instance uuid f5a47886-efa7-4829-892c-66f1002433f6 {{(pid=124726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:58:14.839168 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-1e6133fe-aea0-4c1c-8402-a97b6d5f930a tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'debdf689e44c48e1bca1c7ad37f8335f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6338088b03415aa67ca34647ca0700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:58:14.846620 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-1e6133fe-aea0-4c1c-8402-a97b6d5f930a tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a47886-efa7-4829-892c-66f1002433f6" status: 200 len: 1303 microversion: 2.1 time: 0.098111 Aug 09 18:58:14.847174 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 501/1032] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:58:14 2022] GET /compute/v2.1/servers/f5a47886-efa7-4829-892c-66f1002433f6 => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:58:15.870041 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-9f3121b3-0f0f-41e9-af9b-5706a838cc3f tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:58:15.870839 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-9f3121b3-0f0f-41e9-af9b-5706a838cc3f tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] [instance: f5a47886-efa7-4829-892c-66f1002433f6] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:58:15.876963 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9f3121b3-0f0f-41e9-af9b-5706a838cc3f tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:15.884207 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9f3121b3-0f0f-41e9-af9b-5706a838cc3f tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:15.884207 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9f3121b3-0f0f-41e9-af9b-5706a838cc3f tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:15.884207 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9f3121b3-0f0f-41e9-af9b-5706a838cc3f tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:15.884207 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9f3121b3-0f0f-41e9-af9b-5706a838cc3f tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:15.884586 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9f3121b3-0f0f-41e9-af9b-5706a838cc3f tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:15.892505 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-9f3121b3-0f0f-41e9-af9b-5706a838cc3f tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] HTTP exception thrown: Instance f5a47886-efa7-4829-892c-66f1002433f6 could not be found. Aug 09 18:58:15.894171 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-9f3121b3-0f0f-41e9-af9b-5706a838cc3f tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Request method failure captured: Aug 09 18:58:15.894171 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: request: GET /compute/v2.1/servers/f5a47886-efa7-4829-892c-66f1002433f6 HTTP/1.1 Aug 09 18:58:15.894171 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept: application/json Aug 09 18:58:15.894171 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Aug 09 18:58:15.894171 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Connection: close Aug 09 18:58:15.894171 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Length: 0 Aug 09 18:58:15.894171 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Type: application/json Aug 09 18:58:15.894171 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Host: 10.222.0.57 Aug 09 18:58:15.894171 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Aug 09 18:58:15.894171 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.11 Aug 09 18:58:15.894171 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABi8q4Tq9U42_Z4uvEDWvAn2e8rM6WmAJ-ZSXcRz36qDv2ZsWcwDD1SW-w2hk0GBIn1FXhwD6Vykpn_iYLkJlB75nU26B6e-IQjvoS8NzgnEb33jF1cGZ4X6XXk4tuUIxlJqe7WReJgxvPE3F_5_63fg1fp_2KgWkONBAroVb61GBYHrOw Aug 09 18:58:15.894171 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Aug 09 18:58:15.894171 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Aug 09 18:58:15.894171 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Aug 09 18:58:15.894171 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Aug 09 18:58:15.894171 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Aug 09 18:58:15.894171 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Aug 09 18:58:15.894171 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Id: 8b6338088b03415aa67ca34647ca0700 Aug 09 18:58:15.894171 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-VolumesActionsTest-1188152317 Aug 09 18:58:15.894171 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Role: reader,member Aug 09 18:58:15.894171 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Roles: reader,member Aug 09 18:58:15.895836 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8b6338088b03415aa67ca34647ca0700", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8b6338088b03415aa67ca34647ca0700"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8b6338088b03415aa67ca34647ca0700"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8b6338088b03415aa67ca34647ca0700"}]}] Aug 09 18:58:15.895836 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-VolumesActionsTest-1188152317 Aug 09 18:58:15.895836 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 8b6338088b03415aa67ca34647ca0700 Aug 09 18:58:15.895836 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-VolumesActionsTest-1188152317 Aug 09 18:58:15.895836 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User: tempest-VolumesActionsTest-1188152317-project Aug 09 18:58:15.895836 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Aug 09 18:58:15.895836 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Aug 09 18:58:15.895836 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Id: debdf689e44c48e1bca1c7ad37f8335f Aug 09 18:58:15.895836 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-VolumesActionsTest-1188152317-project Aug 09 18:58:15.895836 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: method: > Aug 09 18:58:15.895836 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: exception: Instance f5a47886-efa7-4829-892c-66f1002433f6 could not be found. Aug 09 18:58:15.895836 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: action_args: {'id': 'f5a47886-efa7-4829-892c-66f1002433f6'} Aug 09 18:58:15.896819 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:58:15.896819 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:58:15.896819 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:58:15.896819 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:58:15.896819 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:58:15.896819 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:58:15.896819 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:58:15.896819 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:58:15.896819 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:58:15.896819 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:58:15.896819 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5a47886-efa7-4829-892c-66f1002433f6 could not be found. Aug 09 18:58:15.896819 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:58:15.896819 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:58:15.896819 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:58:15.896819 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:58:15.896819 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:58:15.896819 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:58:15.896819 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:58:15.896819 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:58:15.896819 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:58:15.898426 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:58:15.898426 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:58:15.898426 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:58:15.898426 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:58:15.898426 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:58:15.898426 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:58:15.898426 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:58:15.898426 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5a47886-efa7-4829-892c-66f1002433f6 could not be found. Aug 09 18:58:15.898426 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:58:15.898426 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:58:15.898426 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:58:15.898426 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:58:15.898426 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:58:15.898426 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:58:15.898426 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:58:15.898426 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:58:15.898426 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5a47886-efa7-4829-892c-66f1002433f6 could not be found. Aug 09 18:58:15.898426 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:58:15.899767 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-9f3121b3-0f0f-41e9-af9b-5706a838cc3f tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] Returning 404 to user: Instance f5a47886-efa7-4829-892c-66f1002433f6 could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:58:15.899767 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-9f3121b3-0f0f-41e9-af9b-5706a838cc3f tempest-VolumesActionsTest-1188152317 tempest-VolumesActionsTest-1188152317-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a47886-efa7-4829-892c-66f1002433f6" status: 404 len: 111 microversion: 2.1 time: 0.030940 Aug 09 18:58:15.899767 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 532/1033] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:58:15 2022] GET /compute/v2.1/servers/f5a47886-efa7-4829-892c-66f1002433f6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:58:28.558420 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-c120ca16-cad6-4aa7-86b8-b6f33b080d03 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:58:28.558420 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-c120ca16-cad6-4aa7-86b8-b6f33b080d03 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 77c72fb6-9a7c-43e4-9849-3eb79380b31b] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:58:28.558420 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_api:SELECT=31 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:58:28.559648 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell1:SELECT=76 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:58:28.564941 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c120ca16-cad6-4aa7-86b8-b6f33b080d03 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:28.565587 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c120ca16-cad6-4aa7-86b8-b6f33b080d03 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:28.573399 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c120ca16-cad6-4aa7-86b8-b6f33b080d03 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:28.573399 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c120ca16-cad6-4aa7-86b8-b6f33b080d03 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:28.573399 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c120ca16-cad6-4aa7-86b8-b6f33b080d03 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:28.573399 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c120ca16-cad6-4aa7-86b8-b6f33b080d03 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:28.664376 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.objects.instance [None req-c120ca16-cad6-4aa7-86b8-b6f33b080d03 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lazy-loading 'services' on Instance uuid 77c72fb6-9a7c-43e4-9849-3eb79380b31b {{(pid=124726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:58:29.083212 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-c120ca16-cad6-4aa7-86b8-b6f33b080d03 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "DELETE /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b/os-volume_attachments/67149fd3-6f2f-4773-a4d1-b1c344a5a8af" status: 202 len: 0 microversion: 2.1 time: 0.531642 Aug 09 18:58:29.087538 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 502/1034] 10.222.0.57 () {58 vars in 1416 bytes} [Tue Aug 9 18:58:28 2022] DELETE /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b/os-volume_attachments/67149fd3-6f2f-4773-a4d1-b1c344a5a8af => generated 0 bytes in 534 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:58:30.220640 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-7edd4530-3b9c-4dc8-91c0-b31617c19388 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:58:30.221284 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-7edd4530-3b9c-4dc8-91c0-b31617c19388 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 77c72fb6-9a7c-43e4-9849-3eb79380b31b] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:58:30.224193 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:58:30.225413 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:58:30.230701 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7edd4530-3b9c-4dc8-91c0-b31617c19388 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:30.231455 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7edd4530-3b9c-4dc8-91c0-b31617c19388 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:30.232346 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7edd4530-3b9c-4dc8-91c0-b31617c19388 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:30.233233 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7edd4530-3b9c-4dc8-91c0-b31617c19388 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:30.233868 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7edd4530-3b9c-4dc8-91c0-b31617c19388 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:30.234463 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7edd4530-3b9c-4dc8-91c0-b31617c19388 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:30.276443 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-7edd4530-3b9c-4dc8-91c0-b31617c19388 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 77c72fb6-9a7c-43e4-9849-3eb79380b31b] Going to try to terminate instance {{(pid=124725) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:58:30.689758 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-7edd4530-3b9c-4dc8-91c0-b31617c19388 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "DELETE /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b" status: 204 len: 0 microversion: 2.1 time: 0.472137 Aug 09 18:58:30.691319 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 533/1035] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 9 18:58:30 2022] DELETE /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:58:30.700551 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-7d9c56a6-3cf6-4117-8352-f6c65493cfc5 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:58:30.710092 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-7d9c56a6-3cf6-4117-8352-f6c65493cfc5 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 77c72fb6-9a7c-43e4-9849-3eb79380b31b] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:58:30.710092 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7d9c56a6-3cf6-4117-8352-f6c65493cfc5 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:30.710092 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7d9c56a6-3cf6-4117-8352-f6c65493cfc5 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:30.710803 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7d9c56a6-3cf6-4117-8352-f6c65493cfc5 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:30.711773 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7d9c56a6-3cf6-4117-8352-f6c65493cfc5 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:30.712317 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7d9c56a6-3cf6-4117-8352-f6c65493cfc5 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:30.712762 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7d9c56a6-3cf6-4117-8352-f6c65493cfc5 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:30.871250 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-7d9c56a6-3cf6-4117-8352-f6c65493cfc5 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:58:30.880274 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-7d9c56a6-3cf6-4117-8352-f6c65493cfc5 tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b" status: 200 len: 1514 microversion: 2.1 time: 0.184150 Aug 09 18:58:30.880859 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 503/1036] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:58:30 2022] GET /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b => generated 1514 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:58:31.903459 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c008000a-5556-4a15-8694-f6bd372f388f tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:58:31.934741 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-c008000a-5556-4a15-8694-f6bd372f388f tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 77c72fb6-9a7c-43e4-9849-3eb79380b31b] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:58:31.934741 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c008000a-5556-4a15-8694-f6bd372f388f tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:31.934741 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c008000a-5556-4a15-8694-f6bd372f388f tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:31.934741 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c008000a-5556-4a15-8694-f6bd372f388f tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:31.935193 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c008000a-5556-4a15-8694-f6bd372f388f tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:31.935193 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c008000a-5556-4a15-8694-f6bd372f388f tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:31.935193 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c008000a-5556-4a15-8694-f6bd372f388f tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:32.049426 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-c008000a-5556-4a15-8694-f6bd372f388f tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:58:32.057260 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-c008000a-5556-4a15-8694-f6bd372f388f tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b" status: 200 len: 1514 microversion: 2.1 time: 0.158245 Aug 09 18:58:32.058072 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 534/1037] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:58:31 2022] GET /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:58:33.080038 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-faf02d9d-bbd3-4fa9-94ab-ac0393fb910d tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:58:33.080674 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-faf02d9d-bbd3-4fa9-94ab-ac0393fb910d tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 77c72fb6-9a7c-43e4-9849-3eb79380b31b] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:58:33.087122 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-faf02d9d-bbd3-4fa9-94ab-ac0393fb910d tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:33.087638 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-faf02d9d-bbd3-4fa9-94ab-ac0393fb910d tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:33.088070 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-faf02d9d-bbd3-4fa9-94ab-ac0393fb910d tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:33.088775 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-faf02d9d-bbd3-4fa9-94ab-ac0393fb910d tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:33.089223 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-faf02d9d-bbd3-4fa9-94ab-ac0393fb910d tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:33.089966 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-faf02d9d-bbd3-4fa9-94ab-ac0393fb910d tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:33.297774 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-faf02d9d-bbd3-4fa9-94ab-ac0393fb910d tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:58:33.308512 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-faf02d9d-bbd3-4fa9-94ab-ac0393fb910d tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b" status: 200 len: 1514 microversion: 2.1 time: 0.232257 Aug 09 18:58:33.326468 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 504/1038] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:58:33 2022] GET /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b => generated 1514 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:58:33.468642 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-85f665ce-c213-49bd-8828-1340d86b6440 req-5599c1fc-0a2b-45d3-ad47-d4404f4001af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77c72fb6-9a7c-43e4-9849-3eb79380b31b", "name": "network-vif-deleted", "tag": "e40ff188-6781-440f-90b6-a548ddce22f8"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:58:33.486687 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-85f665ce-c213-49bd-8828-1340d86b6440 req-5599c1fc-0a2b-45d3-ad47-d4404f4001af service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:33.486687 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-85f665ce-c213-49bd-8828-1340d86b6440 req-5599c1fc-0a2b-45d3-ad47-d4404f4001af service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:33.486687 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-85f665ce-c213-49bd-8828-1340d86b6440 req-5599c1fc-0a2b-45d3-ad47-d4404f4001af service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:33.491875 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-85f665ce-c213-49bd-8828-1340d86b6440 req-5599c1fc-0a2b-45d3-ad47-d4404f4001af service nova] Creating event network-vif-deleted:e40ff188-6781-440f-90b6-a548ddce22f8 for instance 77c72fb6-9a7c-43e4-9849-3eb79380b31b on hv-cinder-82660 Aug 09 18:58:33.498004 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-85f665ce-c213-49bd-8828-1340d86b6440 req-5599c1fc-0a2b-45d3-ad47-d4404f4001af service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032980 Aug 09 18:58:33.498732 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 535/1039] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:58:34.335256 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-3f2d77ed-bc65-48d0-9674-2ccf3d78a41e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:58:34.335853 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-3f2d77ed-bc65-48d0-9674-2ccf3d78a41e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 77c72fb6-9a7c-43e4-9849-3eb79380b31b] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:58:34.343690 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3f2d77ed-bc65-48d0-9674-2ccf3d78a41e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:34.344483 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3f2d77ed-bc65-48d0-9674-2ccf3d78a41e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:34.345007 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3f2d77ed-bc65-48d0-9674-2ccf3d78a41e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:34.345750 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3f2d77ed-bc65-48d0-9674-2ccf3d78a41e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:34.346205 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3f2d77ed-bc65-48d0-9674-2ccf3d78a41e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:34.346816 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3f2d77ed-bc65-48d0-9674-2ccf3d78a41e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:34.383225 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3f2d77ed-bc65-48d0-9674-2ccf3d78a41e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:34.383896 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3f2d77ed-bc65-48d0-9674-2ccf3d78a41e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:34.384428 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-3f2d77ed-bc65-48d0-9674-2ccf3d78a41e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:34.384979 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.objects.instance [None req-3f2d77ed-bc65-48d0-9674-2ccf3d78a41e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lazy-loading 'fault' on Instance uuid 77c72fb6-9a7c-43e4-9849-3eb79380b31b {{(pid=124726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:58:34.439775 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-3f2d77ed-bc65-48d0-9674-2ccf3d78a41e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa415c4e0e9c4928b51152fa0a428d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e81a89ed40c43f28ac96cbe3744e6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:58:34.447787 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-3f2d77ed-bc65-48d0-9674-2ccf3d78a41e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b" status: 200 len: 1309 microversion: 2.1 time: 0.117359 Aug 09 18:58:34.448374 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 505/1040] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:58:34 2022] GET /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b => generated 1309 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:58:35.482134 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a32f013e-13a2-4bae-9912-a7feb4efc31e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:58:35.482806 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-a32f013e-13a2-4bae-9912-a7feb4efc31e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] [instance: 77c72fb6-9a7c-43e4-9849-3eb79380b31b] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:58:35.497620 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a32f013e-13a2-4bae-9912-a7feb4efc31e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:35.498194 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a32f013e-13a2-4bae-9912-a7feb4efc31e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:35.499406 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a32f013e-13a2-4bae-9912-a7feb4efc31e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:35.499782 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a32f013e-13a2-4bae-9912-a7feb4efc31e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:35.500379 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a32f013e-13a2-4bae-9912-a7feb4efc31e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:35.500831 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a32f013e-13a2-4bae-9912-a7feb4efc31e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:35.516262 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-a32f013e-13a2-4bae-9912-a7feb4efc31e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] HTTP exception thrown: Instance 77c72fb6-9a7c-43e4-9849-3eb79380b31b could not be found. Aug 09 18:58:35.519040 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a32f013e-13a2-4bae-9912-a7feb4efc31e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Request method failure captured: Aug 09 18:58:35.519040 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: request: GET /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b HTTP/1.1 Aug 09 18:58:35.519040 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept: application/json Aug 09 18:58:35.519040 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Aug 09 18:58:35.519040 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Connection: close Aug 09 18:58:35.519040 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Length: 0 Aug 09 18:58:35.519040 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Type: application/json Aug 09 18:58:35.519040 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Host: 10.222.0.57 Aug 09 18:58:35.519040 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Aug 09 18:58:35.519040 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.11 Aug 09 18:58:35.519040 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABi8q3J9ZMpW2qJVgl-oDicJLlXhAw7jJ13KXPahbCllzijIaBZcstfAPQB8h94MCfE7ykLE93QHxV4QY2UMRff9DBVozFgt62K0UqdIntPi2EHQh2pjC36EqjmgGCdcDZcR3KAa1kwd1Ar_q7tiEUpf2Fzt3CuwIWvedTy3xRxviXclHo Aug 09 18:58:35.519040 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Aug 09 18:58:35.519040 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Aug 09 18:58:35.519040 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Aug 09 18:58:35.519040 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Aug 09 18:58:35.519040 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Aug 09 18:58:35.519040 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Aug 09 18:58:35.519040 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Id: 7e81a89ed40c43f28ac96cbe3744e6c0 Aug 09 18:58:35.519040 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1946863862 Aug 09 18:58:35.519040 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Role: reader,member Aug 09 18:58:35.519040 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Roles: reader,member Aug 09 18:58:35.520568 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_7e81a89ed40c43f28ac96cbe3744e6c0", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7e81a89ed40c43f28ac96cbe3744e6c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/7e81a89ed40c43f28ac96cbe3744e6c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7e81a89ed40c43f28ac96cbe3744e6c0"}]}] Aug 09 18:58:35.520568 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-VolumesSnapshotTestJSON-1946863862 Aug 09 18:58:35.520568 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 7e81a89ed40c43f28ac96cbe3744e6c0 Aug 09 18:58:35.520568 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1946863862 Aug 09 18:58:35.520568 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User: tempest-VolumesSnapshotTestJSON-1946863862-project Aug 09 18:58:35.520568 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Aug 09 18:58:35.520568 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Aug 09 18:58:35.520568 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Id: aa415c4e0e9c4928b51152fa0a428d9b Aug 09 18:58:35.520568 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-VolumesSnapshotTestJSON-1946863862-project Aug 09 18:58:35.520568 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: method: > Aug 09 18:58:35.520568 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: exception: Instance 77c72fb6-9a7c-43e4-9849-3eb79380b31b could not be found. Aug 09 18:58:35.520568 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: action_args: {'id': '77c72fb6-9a7c-43e4-9849-3eb79380b31b'} Aug 09 18:58:35.521411 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:58:35.521411 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:58:35.521411 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:58:35.521411 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:58:35.521411 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:58:35.521411 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:58:35.521411 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:58:35.521411 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:58:35.521411 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:58:35.521411 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:58:35.521411 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77c72fb6-9a7c-43e4-9849-3eb79380b31b could not be found. Aug 09 18:58:35.521411 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:58:35.521411 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:58:35.521411 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:58:35.521411 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:58:35.521411 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:58:35.521411 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:58:35.521411 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:58:35.521411 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:58:35.521411 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:58:35.523373 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:58:35.523373 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:58:35.523373 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:58:35.523373 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:58:35.523373 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:58:35.523373 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:58:35.523373 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:58:35.523373 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77c72fb6-9a7c-43e4-9849-3eb79380b31b could not be found. Aug 09 18:58:35.523373 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:58:35.523373 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:58:35.523373 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:58:35.523373 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:58:35.523373 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:58:35.523373 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:58:35.523373 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:58:35.523373 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:58:35.523373 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77c72fb6-9a7c-43e4-9849-3eb79380b31b could not be found. Aug 09 18:58:35.523373 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:58:35.524941 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a32f013e-13a2-4bae-9912-a7feb4efc31e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] Returning 404 to user: Instance 77c72fb6-9a7c-43e4-9849-3eb79380b31b could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:58:35.524941 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-a32f013e-13a2-4bae-9912-a7feb4efc31e tempest-VolumesSnapshotTestJSON-1946863862 tempest-VolumesSnapshotTestJSON-1946863862-project] 10.222.0.57 "GET /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b" status: 404 len: 111 microversion: 2.1 time: 0.054723 Aug 09 18:58:35.524941 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 536/1041] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:58:35 2022] GET /compute/v2.1/servers/77c72fb6-9a7c-43e4-9849-3eb79380b31b => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:58:46.913824 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-5cfba7d5-2ea6-49c1-be85-5442f667f82e tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-210458069"}} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:58:46.917591 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-5cfba7d5-2ea6-49c1-be85-5442f667f82e tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:58:46.921856 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_api:SELECT=10 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:58:46.923655 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:58:46.929567 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5cfba7d5-2ea6-49c1-be85-5442f667f82e tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:46.930626 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5cfba7d5-2ea6-49c1-be85-5442f667f82e tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:46.931293 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5cfba7d5-2ea6-49c1-be85-5442f667f82e tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:46.931955 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5cfba7d5-2ea6-49c1-be85-5442f667f82e tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:46.932476 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5cfba7d5-2ea6-49c1-be85-5442f667f82e tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:46.932980 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5cfba7d5-2ea6-49c1-be85-5442f667f82e tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:47.261885 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.network.security_group_api [None req-5cfba7d5-2ea6-49c1-be85-5442f667f82e tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Removing security group cccda923-aee6-46dd-8718-709930853f4f from port d042031b-a302-4388-99a8-e8c5cc484000 Aug 09 18:58:47.739566 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-5cfba7d5-2ea6-49c1-be85-5442f667f82e tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "POST /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212/action" status: 202 len: 0 microversion: 2.1 time: 0.835766 Aug 09 18:58:47.740297 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 506/1042] 10.222.0.57 () {60 vars in 1278 bytes} [Tue Aug 9 18:58:46 2022] POST /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212/action => generated 0 bytes in 837 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:58:47.749995 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-4494afb3-f1f0-45d5-83f0-e3abcbfa9401 req-52b3a4f8-3ddc-412f-9ec4-67111def8516 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62994491-4240-4199-9ae0-b9ac533e3212", "tag": "d042031b-a302-4388-99a8-e8c5cc484000"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:58:47.755510 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:58:47.756231 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:58:47.762206 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-4494afb3-f1f0-45d5-83f0-e3abcbfa9401 req-52b3a4f8-3ddc-412f-9ec4-67111def8516 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:47.762805 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-4494afb3-f1f0-45d5-83f0-e3abcbfa9401 req-52b3a4f8-3ddc-412f-9ec4-67111def8516 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:47.763146 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-4494afb3-f1f0-45d5-83f0-e3abcbfa9401 req-52b3a4f8-3ddc-412f-9ec4-67111def8516 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:47.777191 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-4494afb3-f1f0-45d5-83f0-e3abcbfa9401 req-52b3a4f8-3ddc-412f-9ec4-67111def8516 service nova] Creating event network-changed:d042031b-a302-4388-99a8-e8c5cc484000 for instance 62994491-4240-4199-9ae0-b9ac533e3212 on hv-cinder-82660 Aug 09 18:58:47.790752 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-4494afb3-f1f0-45d5-83f0-e3abcbfa9401 req-52b3a4f8-3ddc-412f-9ec4-67111def8516 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045293 Aug 09 18:58:47.796284 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 537/1043] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:58:49.146717 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-98cbf99c-05bf-40de-8f13-699736dccb29 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:58:49.147226 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-98cbf99c-05bf-40de-8f13-699736dccb29 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:58:49.154134 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-98cbf99c-05bf-40de-8f13-699736dccb29 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:49.154824 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-98cbf99c-05bf-40de-8f13-699736dccb29 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:49.155437 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-98cbf99c-05bf-40de-8f13-699736dccb29 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:49.156626 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-98cbf99c-05bf-40de-8f13-699736dccb29 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:49.157294 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-98cbf99c-05bf-40de-8f13-699736dccb29 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:49.157752 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-98cbf99c-05bf-40de-8f13-699736dccb29 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:49.242121 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.objects.instance [None req-98cbf99c-05bf-40de-8f13-699736dccb29 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lazy-loading 'services' on Instance uuid 62994491-4240-4199-9ae0-b9ac533e3212 {{(pid=124726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:58:49.504663 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-98cbf99c-05bf-40de-8f13-699736dccb29 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "DELETE /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212/os-volume_attachments/0927febe-585d-4aea-814d-a33270d9dee3" status: 202 len: 0 microversion: 2.1 time: 0.361186 Aug 09 18:58:49.505516 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 507/1044] 10.222.0.57 () {58 vars in 1416 bytes} [Tue Aug 9 18:58:49 2022] DELETE /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212/os-volume_attachments/0927febe-585d-4aea-814d-a33270d9dee3 => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:58:49.517055 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-68b35f0c-f0db-4e64-b190-ec9a6bb80767 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:58:49.526274 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-68b35f0c-f0db-4e64-b190-ec9a6bb80767 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:58:49.529042 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-68b35f0c-f0db-4e64-b190-ec9a6bb80767 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:49.529732 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-68b35f0c-f0db-4e64-b190-ec9a6bb80767 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:49.531113 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-68b35f0c-f0db-4e64-b190-ec9a6bb80767 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:49.532068 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-68b35f0c-f0db-4e64-b190-ec9a6bb80767 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:49.532517 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-68b35f0c-f0db-4e64-b190-ec9a6bb80767 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:49.532935 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-68b35f0c-f0db-4e64-b190-ec9a6bb80767 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:49.566724 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-68b35f0c-f0db-4e64-b190-ec9a6bb80767 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056805 Aug 09 18:58:49.567551 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 538/1045] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 9 18:58:49 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:58:49.819085 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-89ff3206-5232-4301-8892-8a500792970d req-06561e2e-9eaa-4ab7-bb86-7e0a7b7d2156 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62994491-4240-4199-9ae0-b9ac533e3212", "tag": "d042031b-a302-4388-99a8-e8c5cc484000"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:58:49.830140 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-89ff3206-5232-4301-8892-8a500792970d req-06561e2e-9eaa-4ab7-bb86-7e0a7b7d2156 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:49.830710 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-89ff3206-5232-4301-8892-8a500792970d req-06561e2e-9eaa-4ab7-bb86-7e0a7b7d2156 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:49.831274 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-89ff3206-5232-4301-8892-8a500792970d req-06561e2e-9eaa-4ab7-bb86-7e0a7b7d2156 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:49.843882 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-89ff3206-5232-4301-8892-8a500792970d req-06561e2e-9eaa-4ab7-bb86-7e0a7b7d2156 service nova] Creating event network-changed:d042031b-a302-4388-99a8-e8c5cc484000 for instance 62994491-4240-4199-9ae0-b9ac533e3212 on hv-cinder-82660 Aug 09 18:58:49.849132 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-89ff3206-5232-4301-8892-8a500792970d req-06561e2e-9eaa-4ab7-bb86-7e0a7b7d2156 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035415 Aug 09 18:58:49.849966 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 508/1046] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:58:50.580299 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-1dda8bac-9a9c-4d81-9413-a5cdc198000a tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:58:50.582833 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-1dda8bac-9a9c-4d81-9413-a5cdc198000a tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:58:50.590169 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1dda8bac-9a9c-4d81-9413-a5cdc198000a tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:50.590716 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1dda8bac-9a9c-4d81-9413-a5cdc198000a tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:50.591155 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1dda8bac-9a9c-4d81-9413-a5cdc198000a tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:50.591864 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1dda8bac-9a9c-4d81-9413-a5cdc198000a tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:50.592323 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1dda8bac-9a9c-4d81-9413-a5cdc198000a tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:50.592873 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1dda8bac-9a9c-4d81-9413-a5cdc198000a tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:50.632429 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-1dda8bac-9a9c-4d81-9413-a5cdc198000a tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056651 Aug 09 18:58:50.633460 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 539/1047] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 9 18:58:50 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:58:51.646341 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-377fd16b-9f9d-4d7e-829c-1215bd3eb088 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:58:51.648581 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-377fd16b-9f9d-4d7e-829c-1215bd3eb088 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:58:51.657393 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-377fd16b-9f9d-4d7e-829c-1215bd3eb088 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:51.657940 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-377fd16b-9f9d-4d7e-829c-1215bd3eb088 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:51.658381 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-377fd16b-9f9d-4d7e-829c-1215bd3eb088 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:51.659083 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-377fd16b-9f9d-4d7e-829c-1215bd3eb088 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:51.659572 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-377fd16b-9f9d-4d7e-829c-1215bd3eb088 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:51.659998 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-377fd16b-9f9d-4d7e-829c-1215bd3eb088 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:51.689671 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-377fd16b-9f9d-4d7e-829c-1215bd3eb088 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047910 Aug 09 18:58:51.690239 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 509/1048] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 9 18:58:51 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 18:58:51.701623 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-2b3f82a3-377e-44b8-855c-144b468fc9ed tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:58:51.702135 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-2b3f82a3-377e-44b8-855c-144b468fc9ed tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:58:51.709131 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2b3f82a3-377e-44b8-855c-144b468fc9ed tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:51.709630 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2b3f82a3-377e-44b8-855c-144b468fc9ed tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:51.710061 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2b3f82a3-377e-44b8-855c-144b468fc9ed tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:51.710784 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2b3f82a3-377e-44b8-855c-144b468fc9ed tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:51.711228 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2b3f82a3-377e-44b8-855c-144b468fc9ed tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:51.711637 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2b3f82a3-377e-44b8-855c-144b468fc9ed tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:51.951992 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-2b3f82a3-377e-44b8-855c-144b468fc9ed tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] HTTP exception thrown: Instance 62994491-4240-4199-9ae0-b9ac533e3212 is not attached to volume 0927febe-585d-4aea-814d-a33270d9dee3 Aug 09 18:58:51.954589 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-2b3f82a3-377e-44b8-855c-144b468fc9ed tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Request method failure captured: Aug 09 18:58:51.954589 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: request: DELETE /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212/os-volume_attachments/0927febe-585d-4aea-814d-a33270d9dee3 HTTP/1.1 Aug 09 18:58:51.954589 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept: application/json Aug 09 18:58:51.954589 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Aug 09 18:58:51.954589 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Connection: close Aug 09 18:58:51.954589 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Length: 0 Aug 09 18:58:51.954589 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Type: application/json Aug 09 18:58:51.954589 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Host: 10.222.0.57 Aug 09 18:58:51.954589 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Aug 09 18:58:51.954589 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.11 Aug 09 18:58:51.954589 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABi8q2yPrKfMlrS9egM6-C1t-s9Rg7UJPNhq7pTILJN5UJ4AGOQizEFjf5gZLdVg2DqwDK6RpqximVQyEb2fkrpZeO1pS4KWlLdM7-BAnAxTWPJtMvAqIdDGrS-VZBf7eUUCVVu5TqtrE2h69IqyYhv6SUhy6HQSt1bsg8GHB1S1o6plPM Aug 09 18:58:51.954589 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Aug 09 18:58:51.954589 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Aug 09 18:58:51.954589 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Aug 09 18:58:51.954589 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Aug 09 18:58:51.954589 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Aug 09 18:58:51.954589 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Aug 09 18:58:51.954589 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Id: 6bedacf1dd4e4398ae3acefcd58a93a8 Aug 09 18:58:51.954589 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-TestMinimumBasicScenario-92519880 Aug 09 18:58:51.954589 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Role: reader,member Aug 09 18:58:51.954589 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Roles: reader,member Aug 09 18:58:51.956259 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_6bedacf1dd4e4398ae3acefcd58a93a8", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6bedacf1dd4e4398ae3acefcd58a93a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/6bedacf1dd4e4398ae3acefcd58a93a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6bedacf1dd4e4398ae3acefcd58a93a8"}]}] Aug 09 18:58:51.956259 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-TestMinimumBasicScenario-92519880 Aug 09 18:58:51.956259 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 6bedacf1dd4e4398ae3acefcd58a93a8 Aug 09 18:58:51.956259 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-TestMinimumBasicScenario-92519880 Aug 09 18:58:51.956259 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User: tempest-TestMinimumBasicScenario-92519880-project Aug 09 18:58:51.956259 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Aug 09 18:58:51.956259 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Aug 09 18:58:51.956259 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Id: db26f48da0af4723afb2c0a4c5f52d07 Aug 09 18:58:51.956259 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-TestMinimumBasicScenario-92519880-project Aug 09 18:58:51.956259 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: method: > Aug 09 18:58:51.956259 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: exception: Instance 62994491-4240-4199-9ae0-b9ac533e3212 is not attached to volume 0927febe-585d-4aea-814d-a33270d9dee3 Aug 09 18:58:51.960602 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: action_args: {'server_id': '62994491-4240-4199-9ae0-b9ac533e3212', 'id': '0927febe-585d-4aea-814d-a33270d9dee3'} Aug 09 18:58:51.960602 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:58:51.960602 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:58:51.960602 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 09 18:58:51.960602 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 09 18:58:51.960602 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 18:58:51.960602 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 18:58:51.960602 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 09 18:58:51.960602 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 09 18:58:51.960602 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0927febe-585d-4aea-814d-a33270d9dee3. Aug 09 18:58:51.960602 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:58:51.960602 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:58:51.960602 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:58:51.960602 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:58:51.960602 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:58:51.960602 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:58:51.960602 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:58:51.960602 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:58:51.960602 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:58:51.962353 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:58:51.962353 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 09 18:58:51.962353 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 09 18:58:51.962353 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62994491-4240-4199-9ae0-b9ac533e3212 is not attached to volume 0927febe-585d-4aea-814d-a33270d9dee3 Aug 09 18:58:51.962353 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:58:51.962353 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:58:51.962353 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:58:51.962353 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:58:51.962353 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:58:51.962353 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:58:51.962353 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:58:51.962353 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:58:51.962353 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62994491-4240-4199-9ae0-b9ac533e3212 is not attached to volume 0927febe-585d-4aea-814d-a33270d9dee3 Aug 09 18:58:51.962353 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:58:51.962353 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-2b3f82a3-377e-44b8-855c-144b468fc9ed tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Returning 404 to user: Instance 62994491-4240-4199-9ae0-b9ac533e3212 is not attached to volume 0927febe-585d-4aea-814d-a33270d9dee3 {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:58:51.963503 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-2b3f82a3-377e-44b8-855c-144b468fc9ed tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "DELETE /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212/os-volume_attachments/0927febe-585d-4aea-814d-a33270d9dee3" status: 404 len: 154 microversion: 2.1 time: 0.259114 Aug 09 18:58:51.963503 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 540/1049] 10.222.0.57 () {58 vars in 1416 bytes} [Tue Aug 9 18:58:51 2022] DELETE /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212/os-volume_attachments/0927febe-585d-4aea-814d-a33270d9dee3 => generated 154 bytes in 260 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:58:52.110929 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 18:58:52.111187 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Tue Aug 9 18:58:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 18:58:53.462952 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-e85d08e5-c5cd-40f4-94d2-b261e22fab7c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:58:53.463745 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-e85d08e5-c5cd-40f4-94d2-b261e22fab7c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:58:53.471262 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e85d08e5-c5cd-40f4-94d2-b261e22fab7c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:53.471889 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e85d08e5-c5cd-40f4-94d2-b261e22fab7c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:53.472419 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e85d08e5-c5cd-40f4-94d2-b261e22fab7c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:53.473298 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e85d08e5-c5cd-40f4-94d2-b261e22fab7c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:53.474269 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e85d08e5-c5cd-40f4-94d2-b261e22fab7c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:53.474791 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e85d08e5-c5cd-40f4-94d2-b261e22fab7c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:53.504517 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-e85d08e5-c5cd-40f4-94d2-b261e22fab7c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Going to try to terminate instance {{(pid=124726) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:58:53.922245 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-e85d08e5-c5cd-40f4-94d2-b261e22fab7c tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "DELETE /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 204 len: 0 microversion: 2.1 time: 0.463670 Aug 09 18:58:53.922814 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 510/1050] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 9 18:58:53 2022] DELETE /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:58:53.931318 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-31f9c96e-dc1e-4c8a-a49a-69f590d1ea69 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:58:53.931915 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-31f9c96e-dc1e-4c8a-a49a-69f590d1ea69 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:58:53.939571 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-31f9c96e-dc1e-4c8a-a49a-69f590d1ea69 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:53.940050 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-31f9c96e-dc1e-4c8a-a49a-69f590d1ea69 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:53.940481 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-31f9c96e-dc1e-4c8a-a49a-69f590d1ea69 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:53.941170 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-31f9c96e-dc1e-4c8a-a49a-69f590d1ea69 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:53.941726 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-31f9c96e-dc1e-4c8a-a49a-69f590d1ea69 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:53.942213 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-31f9c96e-dc1e-4c8a-a49a-69f590d1ea69 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:54.078888 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-31f9c96e-dc1e-4c8a-a49a-69f590d1ea69 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:58:54.086731 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-31f9c96e-dc1e-4c8a-a49a-69f590d1ea69 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1555 microversion: 2.1 time: 0.159516 Aug 09 18:58:54.087368 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 541/1051] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:58:53 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:58:54.455807 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-93566eb3-854a-42e6-ae5f-dbe12fadf74b tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1741855020", "imageRef": "124dd477-ccfa-4be3-9973-6b1f33b47df8", "flavorRef": "452"}} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:58:54.515017 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.network.neutron [None req-93566eb3-854a-42e6-ae5f-dbe12fadf74b tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] validate_networks() for None {{(pid=124726) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:58:55.068174 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.virt.hardware [None req-93566eb3-854a-42e6-ae5f-dbe12fadf74b tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Flavor limits 0:0:0 {{(pid=124726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:58:55.068595 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.virt.hardware [None req-93566eb3-854a-42e6-ae5f-dbe12fadf74b tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Image limits 0:0:0 {{(pid=124726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:58:55.069067 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.virt.hardware [None req-93566eb3-854a-42e6-ae5f-dbe12fadf74b tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Flavor pref 0:0:0 {{(pid=124726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:58:55.069472 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.virt.hardware [None req-93566eb3-854a-42e6-ae5f-dbe12fadf74b tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Image pref 0:0:0 {{(pid=124726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:58:55.069914 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.virt.hardware [None req-93566eb3-854a-42e6-ae5f-dbe12fadf74b tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:58:55.079197 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-93566eb3-854a-42e6-ae5f-dbe12fadf74b tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:55.079725 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-93566eb3-854a-42e6-ae5f-dbe12fadf74b tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:55.080110 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-93566eb3-854a-42e6-ae5f-dbe12fadf74b tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:55.080825 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-93566eb3-854a-42e6-ae5f-dbe12fadf74b tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:55.081274 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-93566eb3-854a-42e6-ae5f-dbe12fadf74b tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:55.081730 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-93566eb3-854a-42e6-ae5f-dbe12fadf74b tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:55.098687 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.quota [None req-93566eb3-854a-42e6-ae5f-dbe12fadf74b tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Getting quotas for project 86a19ee530074672936cd7f57f1b4b84. Resources: {'cores', 'ram', 'instances'} {{(pid=124726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:58:55.102670 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.quota [None req-93566eb3-854a-42e6-ae5f-dbe12fadf74b tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Getting quotas for user 4869cb3da4044b1dbc2b4f81a9c24607 and project 86a19ee530074672936cd7f57f1b4b84. Resources: {'cores', 'ram', 'instances'} {{(pid=124726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:58:55.108237 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-9c7b8115-9f0f-4e6f-9a78-421425ddb100 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:58:55.108911 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-9c7b8115-9f0f-4e6f-9a78-421425ddb100 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:58:55.115106 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-93566eb3-854a-42e6-ae5f-dbe12fadf74b tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Going to run 1 instances... {{(pid=124726) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:58:55.116630 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9c7b8115-9f0f-4e6f-9a78-421425ddb100 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:55.117264 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9c7b8115-9f0f-4e6f-9a78-421425ddb100 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:55.117466 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-93566eb3-854a-42e6-ae5f-dbe12fadf74b tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] [instance: 7138c016-225d-473e-9a66-b91fe89618eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='124dd477-ccfa-4be3-9973-6b1f33b47df8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:58:55.117887 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9c7b8115-9f0f-4e6f-9a78-421425ddb100 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:55.118593 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9c7b8115-9f0f-4e6f-9a78-421425ddb100 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:55.119079 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9c7b8115-9f0f-4e6f-9a78-421425ddb100 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:55.119503 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9c7b8115-9f0f-4e6f-9a78-421425ddb100 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:55.257224 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-9c7b8115-9f0f-4e6f-9a78-421425ddb100 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:58:55.265071 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-9c7b8115-9f0f-4e6f-9a78-421425ddb100 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1555 microversion: 2.1 time: 0.160544 Aug 09 18:58:55.265792 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 542/1052] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:58:55 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:58:55.295266 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-93566eb3-854a-42e6-ae5f-dbe12fadf74b tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.843619 Aug 09 18:58:55.295876 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 511/1053] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 9 18:58:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:58:55.306545 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a4513b7d-664e-4f9e-891c-e2d0a0cdf1cd tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:58:55.307399 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-a4513b7d-664e-4f9e-891c-e2d0a0cdf1cd tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] [instance: 7138c016-225d-473e-9a66-b91fe89618eb] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:58:55.360564 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-a4513b7d-664e-4f9e-891c-e2d0a0cdf1cd tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4869cb3da4044b1dbc2b4f81a9c24607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a19ee530074672936cd7f57f1b4b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:58:55.367193 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-a4513b7d-664e-4f9e-891c-e2d0a0cdf1cd tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] 10.222.0.57 "GET /compute/v2.1/servers/7138c016-225d-473e-9a66-b91fe89618eb" status: 200 len: 1215 microversion: 2.1 time: 0.064444 Aug 09 18:58:55.367893 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 543/1054] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:58:55 2022] GET /compute/v2.1/servers/7138c016-225d-473e-9a66-b91fe89618eb => generated 1215 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:58:56.255503 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-32712158-42c6-4b37-878b-61a5e2c7f272 req-abfebdb9-49b3-4fb6-acab-921a8858e008 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62994491-4240-4199-9ae0-b9ac533e3212", "name": "network-vif-deleted", "tag": "d042031b-a302-4388-99a8-e8c5cc484000"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:58:56.276606 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-32712158-42c6-4b37-878b-61a5e2c7f272 req-abfebdb9-49b3-4fb6-acab-921a8858e008 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:56.277158 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-32712158-42c6-4b37-878b-61a5e2c7f272 req-abfebdb9-49b3-4fb6-acab-921a8858e008 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:56.277621 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-32712158-42c6-4b37-878b-61a5e2c7f272 req-abfebdb9-49b3-4fb6-acab-921a8858e008 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:56.285782 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-65bd63de-fcfe-4283-8d51-1fd9174f1604 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:58:56.287186 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-65bd63de-fcfe-4283-8d51-1fd9174f1604 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:58:56.288674 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-32712158-42c6-4b37-878b-61a5e2c7f272 req-abfebdb9-49b3-4fb6-acab-921a8858e008 service nova] Creating event network-vif-deleted:d042031b-a302-4388-99a8-e8c5cc484000 for instance 62994491-4240-4199-9ae0-b9ac533e3212 on hv-cinder-82660 Aug 09 18:58:56.293869 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-32712158-42c6-4b37-878b-61a5e2c7f272 req-abfebdb9-49b3-4fb6-acab-921a8858e008 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041970 Aug 09 18:58:56.294529 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 512/1055] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:58:56.294669 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-65bd63de-fcfe-4283-8d51-1fd9174f1604 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:56.299474 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-65bd63de-fcfe-4283-8d51-1fd9174f1604 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:56.299474 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-65bd63de-fcfe-4283-8d51-1fd9174f1604 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:56.299474 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-65bd63de-fcfe-4283-8d51-1fd9174f1604 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:56.299474 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-65bd63de-fcfe-4283-8d51-1fd9174f1604 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:56.300232 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-65bd63de-fcfe-4283-8d51-1fd9174f1604 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:56.377504 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-65bd63de-fcfe-4283-8d51-1fd9174f1604 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:58:56.384933 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-65bd63de-fcfe-4283-8d51-1fd9174f1604 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1513 microversion: 2.1 time: 0.102955 Aug 09 18:58:56.385492 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 544/1056] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:58:56 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1513 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:58:56.390028 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-68f06f27-653e-417d-9661-94d54f3eae70 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:58:56.390762 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-68f06f27-653e-417d-9661-94d54f3eae70 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] [instance: 7138c016-225d-473e-9a66-b91fe89618eb] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:58:56.444424 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-68f06f27-653e-417d-9661-94d54f3eae70 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4869cb3da4044b1dbc2b4f81a9c24607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a19ee530074672936cd7f57f1b4b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:58:56.451989 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-68f06f27-653e-417d-9661-94d54f3eae70 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] 10.222.0.57 "GET /compute/v2.1/servers/7138c016-225d-473e-9a66-b91fe89618eb" status: 200 len: 1215 microversion: 2.1 time: 0.067067 Aug 09 18:58:56.452567 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 513/1057] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:58:56 2022] GET /compute/v2.1/servers/7138c016-225d-473e-9a66-b91fe89618eb => generated 1215 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:58:57.406987 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-10994094-d7b7-4492-ae8d-ed85a03f6eb5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:58:57.407618 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-10994094-d7b7-4492-ae8d-ed85a03f6eb5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:58:57.415893 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-10994094-d7b7-4492-ae8d-ed85a03f6eb5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:57.416627 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-10994094-d7b7-4492-ae8d-ed85a03f6eb5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:57.417290 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-10994094-d7b7-4492-ae8d-ed85a03f6eb5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:57.418403 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-10994094-d7b7-4492-ae8d-ed85a03f6eb5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:57.419103 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-10994094-d7b7-4492-ae8d-ed85a03f6eb5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:57.419785 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-10994094-d7b7-4492-ae8d-ed85a03f6eb5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:57.463423 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-10994094-d7b7-4492-ae8d-ed85a03f6eb5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:57.464205 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-10994094-d7b7-4492-ae8d-ed85a03f6eb5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:57.464649 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-10994094-d7b7-4492-ae8d-ed85a03f6eb5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:57.465096 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.objects.instance [None req-10994094-d7b7-4492-ae8d-ed85a03f6eb5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lazy-loading 'fault' on Instance uuid 62994491-4240-4199-9ae0-b9ac533e3212 {{(pid=124725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:58:57.473042 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-92ee16c0-ac4f-43de-9242-466883cd9d42 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:58:57.474896 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-92ee16c0-ac4f-43de-9242-466883cd9d42 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] [instance: 7138c016-225d-473e-9a66-b91fe89618eb] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:58:57.489689 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-92ee16c0-ac4f-43de-9242-466883cd9d42 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:57.490179 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-92ee16c0-ac4f-43de-9242-466883cd9d42 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:57.490655 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-92ee16c0-ac4f-43de-9242-466883cd9d42 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:57.491306 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-92ee16c0-ac4f-43de-9242-466883cd9d42 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:57.491752 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-92ee16c0-ac4f-43de-9242-466883cd9d42 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:57.492168 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-92ee16c0-ac4f-43de-9242-466883cd9d42 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:57.513650 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-10994094-d7b7-4492-ae8d-ed85a03f6eb5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db26f48da0af4723afb2c0a4c5f52d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bedacf1dd4e4398ae3acefcd58a93a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:58:57.521025 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-10994094-d7b7-4492-ae8d-ed85a03f6eb5 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 200 len: 1349 microversion: 2.1 time: 0.118625 Aug 09 18:58:57.521842 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 545/1058] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:58:57 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 1349 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:58:57.558478 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-92ee16c0-ac4f-43de-9242-466883cd9d42 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4869cb3da4044b1dbc2b4f81a9c24607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a19ee530074672936cd7f57f1b4b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:58:57.566302 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-92ee16c0-ac4f-43de-9242-466883cd9d42 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] 10.222.0.57 "GET /compute/v2.1/servers/7138c016-225d-473e-9a66-b91fe89618eb" status: 200 len: 1219 microversion: 2.1 time: 0.097096 Aug 09 18:58:57.566873 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 514/1059] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:58:57 2022] GET /compute/v2.1/servers/7138c016-225d-473e-9a66-b91fe89618eb => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:58:58.543166 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-900e5f78-be1e-44a4-9b15-4324970f479b tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:58:58.545152 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-900e5f78-be1e-44a4-9b15-4324970f479b tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] [instance: 62994491-4240-4199-9ae0-b9ac533e3212] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:58:58.552042 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-900e5f78-be1e-44a4-9b15-4324970f479b tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:58.552514 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-900e5f78-be1e-44a4-9b15-4324970f479b tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:58.552943 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-900e5f78-be1e-44a4-9b15-4324970f479b tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:58.553664 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-900e5f78-be1e-44a4-9b15-4324970f479b tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:58.554122 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-900e5f78-be1e-44a4-9b15-4324970f479b tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:58.554578 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-900e5f78-be1e-44a4-9b15-4324970f479b tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:58.568917 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-900e5f78-be1e-44a4-9b15-4324970f479b tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] HTTP exception thrown: Instance 62994491-4240-4199-9ae0-b9ac533e3212 could not be found. Aug 09 18:58:58.570623 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-900e5f78-be1e-44a4-9b15-4324970f479b tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Request method failure captured: Aug 09 18:58:58.570623 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: request: GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 HTTP/1.1 Aug 09 18:58:58.570623 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept: application/json Aug 09 18:58:58.570623 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Aug 09 18:58:58.570623 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Connection: close Aug 09 18:58:58.570623 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Length: 0 Aug 09 18:58:58.570623 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Type: application/json Aug 09 18:58:58.570623 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Host: 10.222.0.57 Aug 09 18:58:58.570623 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Aug 09 18:58:58.570623 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.11 Aug 09 18:58:58.570623 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABi8q2yPrKfMlrS9egM6-C1t-s9Rg7UJPNhq7pTILJN5UJ4AGOQizEFjf5gZLdVg2DqwDK6RpqximVQyEb2fkrpZeO1pS4KWlLdM7-BAnAxTWPJtMvAqIdDGrS-VZBf7eUUCVVu5TqtrE2h69IqyYhv6SUhy6HQSt1bsg8GHB1S1o6plPM Aug 09 18:58:58.570623 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Aug 09 18:58:58.570623 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Aug 09 18:58:58.570623 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Aug 09 18:58:58.570623 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Aug 09 18:58:58.570623 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Aug 09 18:58:58.570623 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Aug 09 18:58:58.570623 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Id: 6bedacf1dd4e4398ae3acefcd58a93a8 Aug 09 18:58:58.570623 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-TestMinimumBasicScenario-92519880 Aug 09 18:58:58.570623 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Role: reader,member Aug 09 18:58:58.570623 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Roles: reader,member Aug 09 18:58:58.572394 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_6bedacf1dd4e4398ae3acefcd58a93a8", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6bedacf1dd4e4398ae3acefcd58a93a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/6bedacf1dd4e4398ae3acefcd58a93a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6bedacf1dd4e4398ae3acefcd58a93a8"}]}] Aug 09 18:58:58.572394 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-TestMinimumBasicScenario-92519880 Aug 09 18:58:58.572394 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 6bedacf1dd4e4398ae3acefcd58a93a8 Aug 09 18:58:58.572394 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-TestMinimumBasicScenario-92519880 Aug 09 18:58:58.572394 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User: tempest-TestMinimumBasicScenario-92519880-project Aug 09 18:58:58.572394 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Aug 09 18:58:58.572394 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Aug 09 18:58:58.572394 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Id: db26f48da0af4723afb2c0a4c5f52d07 Aug 09 18:58:58.572394 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-TestMinimumBasicScenario-92519880-project Aug 09 18:58:58.572394 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: method: > Aug 09 18:58:58.572394 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: exception: Instance 62994491-4240-4199-9ae0-b9ac533e3212 could not be found. Aug 09 18:58:58.572394 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: action_args: {'id': '62994491-4240-4199-9ae0-b9ac533e3212'} Aug 09 18:58:58.573359 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:58:58.573359 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:58:58.573359 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:58:58.573359 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:58:58.573359 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:58:58.573359 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:58:58.573359 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:58:58.573359 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:58:58.573359 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:58:58.573359 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:58:58.573359 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62994491-4240-4199-9ae0-b9ac533e3212 could not be found. Aug 09 18:58:58.573359 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:58:58.573359 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:58:58.573359 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:58:58.573359 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:58:58.573359 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:58:58.573359 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:58:58.573359 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:58:58.573359 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:58:58.573359 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:58:58.575158 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:58:58.575158 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:58:58.575158 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:58:58.575158 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:58:58.575158 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:58:58.575158 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:58:58.575158 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:58:58.575158 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62994491-4240-4199-9ae0-b9ac533e3212 could not be found. Aug 09 18:58:58.575158 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:58:58.575158 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:58:58.575158 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:58:58.575158 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:58:58.575158 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:58:58.575158 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:58:58.575158 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:58:58.575158 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:58:58.575158 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62994491-4240-4199-9ae0-b9ac533e3212 could not be found. Aug 09 18:58:58.575158 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:58:58.576582 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-900e5f78-be1e-44a4-9b15-4324970f479b tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Returning 404 to user: Instance 62994491-4240-4199-9ae0-b9ac533e3212 could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:58:58.576582 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-900e5f78-be1e-44a4-9b15-4324970f479b tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212" status: 404 len: 111 microversion: 2.1 time: 0.032904 Aug 09 18:58:58.576582 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 546/1060] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:58:58 2022] GET /compute/v2.1/servers/62994491-4240-4199-9ae0-b9ac533e3212 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:58:58.580989 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-21b58e80-4beb-4fc8-9b42-3ace3d2e77e0 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] Calling method '.version_select at 0x7f8d6a79aaf0>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:58:58.591922 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-50dad483-0b86-44dd-aad4-cb8b83430cb7 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:58:58.592495 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-50dad483-0b86-44dd-aad4-cb8b83430cb7 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] [instance: 7138c016-225d-473e-9a66-b91fe89618eb] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:58:58.599020 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-50dad483-0b86-44dd-aad4-cb8b83430cb7 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:58.603701 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-50dad483-0b86-44dd-aad4-cb8b83430cb7 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:58.603701 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-50dad483-0b86-44dd-aad4-cb8b83430cb7 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:58.603701 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-50dad483-0b86-44dd-aad4-cb8b83430cb7 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:58.603701 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-50dad483-0b86-44dd-aad4-cb8b83430cb7 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:58.604123 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-50dad483-0b86-44dd-aad4-cb8b83430cb7 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:58.666155 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-50dad483-0b86-44dd-aad4-cb8b83430cb7 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4869cb3da4044b1dbc2b4f81a9c24607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a19ee530074672936cd7f57f1b4b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:58:58.674740 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-50dad483-0b86-44dd-aad4-cb8b83430cb7 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] 10.222.0.57 "GET /compute/v2.1/servers/7138c016-225d-473e-9a66-b91fe89618eb" status: 200 len: 1275 microversion: 2.1 time: 0.087207 Aug 09 18:58:58.675312 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 547/1061] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:58:58 2022] GET /compute/v2.1/servers/7138c016-225d-473e-9a66-b91fe89618eb => generated 1275 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:58:58.751666 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-21b58e80-4beb-4fc8-9b42-3ace3d2e77e0 tempest-TestMinimumBasicScenario-92519880 tempest-TestMinimumBasicScenario-92519880-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1423496390" status: 202 len: 0 microversion: 2.1 time: 0.174611 Aug 09 18:58:58.752407 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 515/1062] 10.222.0.57 () {58 vars in 1272 bytes} [Tue Aug 9 18:58:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1423496390 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:58:59.696222 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-8e1cee5a-91fc-49bf-ae5c-69eef521f58a tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:58:59.698107 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-8e1cee5a-91fc-49bf-ae5c-69eef521f58a tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] [instance: 7138c016-225d-473e-9a66-b91fe89618eb] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:58:59.704922 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8e1cee5a-91fc-49bf-ae5c-69eef521f58a tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:59.706823 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8e1cee5a-91fc-49bf-ae5c-69eef521f58a tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:59.707472 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8e1cee5a-91fc-49bf-ae5c-69eef521f58a tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:59.708865 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8e1cee5a-91fc-49bf-ae5c-69eef521f58a tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:58:59.709438 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8e1cee5a-91fc-49bf-ae5c-69eef521f58a tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:58:59.710177 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8e1cee5a-91fc-49bf-ae5c-69eef521f58a tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:58:59.863074 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-8e1cee5a-91fc-49bf-ae5c-69eef521f58a tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4869cb3da4044b1dbc2b4f81a9c24607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a19ee530074672936cd7f57f1b4b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:58:59.870668 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-8e1cee5a-91fc-49bf-ae5c-69eef521f58a tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] 10.222.0.57 "GET /compute/v2.1/servers/7138c016-225d-473e-9a66-b91fe89618eb" status: 200 len: 1315 microversion: 2.1 time: 0.178425 Aug 09 18:58:59.871261 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 548/1063] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:58:59 2022] GET /compute/v2.1/servers/7138c016-225d-473e-9a66-b91fe89618eb => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:00.643378 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-0aef3a23-c977-45ef-bc08-c7968c527bb8 req-9aba8f7e-292a-4ced-82c7-32a1b7b852b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7138c016-225d-473e-9a66-b91fe89618eb", "tag": "5f85d145-ebaf-48f3-bc05-e1db74c4f2c9"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:59:00.656128 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-0aef3a23-c977-45ef-bc08-c7968c527bb8 req-9aba8f7e-292a-4ced-82c7-32a1b7b852b9 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:00.657603 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-0aef3a23-c977-45ef-bc08-c7968c527bb8 req-9aba8f7e-292a-4ced-82c7-32a1b7b852b9 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:00.658069 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-0aef3a23-c977-45ef-bc08-c7968c527bb8 req-9aba8f7e-292a-4ced-82c7-32a1b7b852b9 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:00.669433 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-0aef3a23-c977-45ef-bc08-c7968c527bb8 req-9aba8f7e-292a-4ced-82c7-32a1b7b852b9 service nova] Creating event network-changed:5f85d145-ebaf-48f3-bc05-e1db74c4f2c9 for instance 7138c016-225d-473e-9a66-b91fe89618eb on hv-cinder-82660 Aug 09 18:59:00.674783 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-0aef3a23-c977-45ef-bc08-c7968c527bb8 req-9aba8f7e-292a-4ced-82c7-32a1b7b852b9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035492 Aug 09 18:59:00.675387 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 516/1064] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:59:00.892334 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-3dd2b0a3-7386-48d2-aedb-edc29815c11f tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:59:00.892943 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-3dd2b0a3-7386-48d2-aedb-edc29815c11f tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] [instance: 7138c016-225d-473e-9a66-b91fe89618eb] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:59:00.899755 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3dd2b0a3-7386-48d2-aedb-edc29815c11f tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:00.913460 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3dd2b0a3-7386-48d2-aedb-edc29815c11f tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:00.913460 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3dd2b0a3-7386-48d2-aedb-edc29815c11f tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:00.913460 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3dd2b0a3-7386-48d2-aedb-edc29815c11f tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:00.913460 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3dd2b0a3-7386-48d2-aedb-edc29815c11f tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:00.913910 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3dd2b0a3-7386-48d2-aedb-edc29815c11f tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:01.051435 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-3dd2b0a3-7386-48d2-aedb-edc29815c11f tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4869cb3da4044b1dbc2b4f81a9c24607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a19ee530074672936cd7f57f1b4b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:59:01.059634 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-3dd2b0a3-7386-48d2-aedb-edc29815c11f tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] 10.222.0.57 "GET /compute/v2.1/servers/7138c016-225d-473e-9a66-b91fe89618eb" status: 200 len: 1315 microversion: 2.1 time: 0.171133 Aug 09 18:59:01.060508 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 549/1065] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:59:00 2022] GET /compute/v2.1/servers/7138c016-225d-473e-9a66-b91fe89618eb => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:02.086453 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-2c9dae5f-4e08-4688-b1aa-fe936fc0d989 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:59:02.087421 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-2c9dae5f-4e08-4688-b1aa-fe936fc0d989 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] [instance: 7138c016-225d-473e-9a66-b91fe89618eb] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:59:02.095837 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2c9dae5f-4e08-4688-b1aa-fe936fc0d989 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:02.096494 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2c9dae5f-4e08-4688-b1aa-fe936fc0d989 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:02.097173 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2c9dae5f-4e08-4688-b1aa-fe936fc0d989 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:02.097941 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2c9dae5f-4e08-4688-b1aa-fe936fc0d989 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:02.100410 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2c9dae5f-4e08-4688-b1aa-fe936fc0d989 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:02.103356 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2c9dae5f-4e08-4688-b1aa-fe936fc0d989 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:02.480067 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-2c9dae5f-4e08-4688-b1aa-fe936fc0d989 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4869cb3da4044b1dbc2b4f81a9c24607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a19ee530074672936cd7f57f1b4b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:59:02.488933 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-2c9dae5f-4e08-4688-b1aa-fe936fc0d989 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] 10.222.0.57 "GET /compute/v2.1/servers/7138c016-225d-473e-9a66-b91fe89618eb" status: 200 len: 1315 microversion: 2.1 time: 0.406971 Aug 09 18:59:02.489634 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 517/1066] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:59:02 2022] GET /compute/v2.1/servers/7138c016-225d-473e-9a66-b91fe89618eb => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:03.518531 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-965e0cd1-3ce9-4975-9545-5b42865e0d24 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:59:03.518531 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-965e0cd1-3ce9-4975-9545-5b42865e0d24 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] [instance: 7138c016-225d-473e-9a66-b91fe89618eb] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:59:03.522872 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-965e0cd1-3ce9-4975-9545-5b42865e0d24 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:03.523459 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-965e0cd1-3ce9-4975-9545-5b42865e0d24 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:03.524012 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-965e0cd1-3ce9-4975-9545-5b42865e0d24 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:03.524989 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-965e0cd1-3ce9-4975-9545-5b42865e0d24 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:03.525576 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-965e0cd1-3ce9-4975-9545-5b42865e0d24 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:03.526101 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-965e0cd1-3ce9-4975-9545-5b42865e0d24 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:03.687454 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-965e0cd1-3ce9-4975-9545-5b42865e0d24 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4869cb3da4044b1dbc2b4f81a9c24607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a19ee530074672936cd7f57f1b4b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:59:03.697379 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-965e0cd1-3ce9-4975-9545-5b42865e0d24 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] 10.222.0.57 "GET /compute/v2.1/servers/7138c016-225d-473e-9a66-b91fe89618eb" status: 200 len: 1315 microversion: 2.1 time: 0.190068 Aug 09 18:59:03.697998 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 550/1067] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:59:03 2022] GET /compute/v2.1/servers/7138c016-225d-473e-9a66-b91fe89618eb => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:04.719866 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-6e828c34-277b-40c4-9876-6d4aebcb2711 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:59:04.721331 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-6e828c34-277b-40c4-9876-6d4aebcb2711 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] [instance: 7138c016-225d-473e-9a66-b91fe89618eb] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:59:04.729880 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6e828c34-277b-40c4-9876-6d4aebcb2711 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:04.729880 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6e828c34-277b-40c4-9876-6d4aebcb2711 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:04.729880 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6e828c34-277b-40c4-9876-6d4aebcb2711 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:04.731626 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6e828c34-277b-40c4-9876-6d4aebcb2711 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:04.732307 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6e828c34-277b-40c4-9876-6d4aebcb2711 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:04.733113 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6e828c34-277b-40c4-9876-6d4aebcb2711 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:04.984818 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-6e828c34-277b-40c4-9876-6d4aebcb2711 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4869cb3da4044b1dbc2b4f81a9c24607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a19ee530074672936cd7f57f1b4b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:59:05.009912 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-6e828c34-277b-40c4-9876-6d4aebcb2711 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] 10.222.0.57 "GET /compute/v2.1/servers/7138c016-225d-473e-9a66-b91fe89618eb" status: 200 len: 1315 microversion: 2.1 time: 0.294984 Aug 09 18:59:05.014477 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 518/1068] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:59:04 2022] GET /compute/v2.1/servers/7138c016-225d-473e-9a66-b91fe89618eb => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:06.034293 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-1dbc6d6b-1c87-420c-8e5e-26aee9f1204a tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:59:06.035736 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-1dbc6d6b-1c87-420c-8e5e-26aee9f1204a tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] [instance: 7138c016-225d-473e-9a66-b91fe89618eb] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:59:06.047125 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=2 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:06.049300 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1dbc6d6b-1c87-420c-8e5e-26aee9f1204a tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:06.050024 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1dbc6d6b-1c87-420c-8e5e-26aee9f1204a tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:06.050712 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1dbc6d6b-1c87-420c-8e5e-26aee9f1204a tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:06.051424 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1dbc6d6b-1c87-420c-8e5e-26aee9f1204a tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:06.051878 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1dbc6d6b-1c87-420c-8e5e-26aee9f1204a tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:06.052307 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1dbc6d6b-1c87-420c-8e5e-26aee9f1204a tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:06.284006 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1dbc6d6b-1c87-420c-8e5e-26aee9f1204a tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4869cb3da4044b1dbc2b4f81a9c24607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a19ee530074672936cd7f57f1b4b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:59:06.295586 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-1dbc6d6b-1c87-420c-8e5e-26aee9f1204a tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] 10.222.0.57 "GET /compute/v2.1/servers/7138c016-225d-473e-9a66-b91fe89618eb" status: 200 len: 1315 microversion: 2.1 time: 0.265478 Aug 09 18:59:06.296417 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 551/1069] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:59:06 2022] GET /compute/v2.1/servers/7138c016-225d-473e-9a66-b91fe89618eb => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:07.216637 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-7f78bc17-6714-46b9-84b5-ce9b27b6f2a4 req-6e77a615-6e9d-4dc9-9de7-1d5ba6cf72b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7138c016-225d-473e-9a66-b91fe89618eb", "name": "network-vif-plugged", "status": "completed", "tag": "5f85d145-ebaf-48f3-bc05-e1db74c4f2c9"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:59:07.226506 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell0:SELECT=2 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:07.228347 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell0:SELECT=8 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:07.234254 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-7f78bc17-6714-46b9-84b5-ce9b27b6f2a4 req-6e77a615-6e9d-4dc9-9de7-1d5ba6cf72b7 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:07.234254 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-7f78bc17-6714-46b9-84b5-ce9b27b6f2a4 req-6e77a615-6e9d-4dc9-9de7-1d5ba6cf72b7 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:07.234254 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-7f78bc17-6714-46b9-84b5-ce9b27b6f2a4 req-6e77a615-6e9d-4dc9-9de7-1d5ba6cf72b7 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:07.243673 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-7f78bc17-6714-46b9-84b5-ce9b27b6f2a4 req-6e77a615-6e9d-4dc9-9de7-1d5ba6cf72b7 service nova] Creating event network-vif-plugged:5f85d145-ebaf-48f3-bc05-e1db74c4f2c9 for instance 7138c016-225d-473e-9a66-b91fe89618eb on hv-cinder-82660 Aug 09 18:59:07.249572 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-7f78bc17-6714-46b9-84b5-ce9b27b6f2a4 req-6e77a615-6e9d-4dc9-9de7-1d5ba6cf72b7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037080 Aug 09 18:59:07.250593 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 519/1070] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:59:07.322633 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5b595e90-31a5-4180-a8cb-57159c52a46c tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:59:07.323251 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-5b595e90-31a5-4180-a8cb-57159c52a46c tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] [instance: 7138c016-225d-473e-9a66-b91fe89618eb] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:59:07.329711 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5b595e90-31a5-4180-a8cb-57159c52a46c tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:07.330197 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5b595e90-31a5-4180-a8cb-57159c52a46c tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:07.330671 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5b595e90-31a5-4180-a8cb-57159c52a46c tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:07.331385 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5b595e90-31a5-4180-a8cb-57159c52a46c tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:07.331848 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5b595e90-31a5-4180-a8cb-57159c52a46c tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:07.332272 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5b595e90-31a5-4180-a8cb-57159c52a46c tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:07.580471 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5b595e90-31a5-4180-a8cb-57159c52a46c tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4869cb3da4044b1dbc2b4f81a9c24607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a19ee530074672936cd7f57f1b4b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:59:07.591360 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-5b595e90-31a5-4180-a8cb-57159c52a46c tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] 10.222.0.57 "GET /compute/v2.1/servers/7138c016-225d-473e-9a66-b91fe89618eb" status: 200 len: 1315 microversion: 2.1 time: 0.272053 Aug 09 18:59:07.592629 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 552/1071] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:59:07 2022] GET /compute/v2.1/servers/7138c016-225d-473e-9a66-b91fe89618eb => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:08.618064 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-cdf8f019-2da1-4eab-8a1e-429f97971bb3 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:59:08.618770 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-cdf8f019-2da1-4eab-8a1e-429f97971bb3 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] [instance: 7138c016-225d-473e-9a66-b91fe89618eb] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:59:08.628667 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cdf8f019-2da1-4eab-8a1e-429f97971bb3 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:08.629414 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cdf8f019-2da1-4eab-8a1e-429f97971bb3 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:08.630734 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cdf8f019-2da1-4eab-8a1e-429f97971bb3 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:08.632273 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cdf8f019-2da1-4eab-8a1e-429f97971bb3 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:08.632965 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cdf8f019-2da1-4eab-8a1e-429f97971bb3 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:08.633597 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-cdf8f019-2da1-4eab-8a1e-429f97971bb3 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:08.879543 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-cdf8f019-2da1-4eab-8a1e-429f97971bb3 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4869cb3da4044b1dbc2b4f81a9c24607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a19ee530074672936cd7f57f1b4b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:59:08.887254 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-cdf8f019-2da1-4eab-8a1e-429f97971bb3 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] 10.222.0.57 "GET /compute/v2.1/servers/7138c016-225d-473e-9a66-b91fe89618eb" status: 200 len: 1315 microversion: 2.1 time: 0.278200 Aug 09 18:59:08.915319 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 520/1072] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:59:08 2022] GET /compute/v2.1/servers/7138c016-225d-473e-9a66-b91fe89618eb => generated 1315 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:09.917617 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c7836063-452b-4f28-aebe-c0a6a4a1b5a4 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:59:09.918336 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-c7836063-452b-4f28-aebe-c0a6a4a1b5a4 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] [instance: 7138c016-225d-473e-9a66-b91fe89618eb] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:59:09.925209 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c7836063-452b-4f28-aebe-c0a6a4a1b5a4 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:09.925737 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c7836063-452b-4f28-aebe-c0a6a4a1b5a4 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:09.926165 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c7836063-452b-4f28-aebe-c0a6a4a1b5a4 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:09.926845 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c7836063-452b-4f28-aebe-c0a6a4a1b5a4 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:09.927288 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c7836063-452b-4f28-aebe-c0a6a4a1b5a4 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:09.927700 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c7836063-452b-4f28-aebe-c0a6a4a1b5a4 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:10.073158 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-c7836063-452b-4f28-aebe-c0a6a4a1b5a4 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4869cb3da4044b1dbc2b4f81a9c24607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a19ee530074672936cd7f57f1b4b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:59:10.081380 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-c7836063-452b-4f28-aebe-c0a6a4a1b5a4 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] 10.222.0.57 "GET /compute/v2.1/servers/7138c016-225d-473e-9a66-b91fe89618eb" status: 200 len: 1465 microversion: 2.1 time: 0.167739 Aug 09 18:59:10.082231 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 553/1073] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:59:09 2022] GET /compute/v2.1/servers/7138c016-225d-473e-9a66-b91fe89618eb => generated 1465 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:10.129152 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-e00bbe8c-cfe3-4964-9447-7c0c4e5741da tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:59:10.129773 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-e00bbe8c-cfe3-4964-9447-7c0c4e5741da tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] [instance: 7138c016-225d-473e-9a66-b91fe89618eb] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:59:10.136573 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e00bbe8c-cfe3-4964-9447-7c0c4e5741da tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:10.137059 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e00bbe8c-cfe3-4964-9447-7c0c4e5741da tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:10.137533 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e00bbe8c-cfe3-4964-9447-7c0c4e5741da tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:10.138820 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e00bbe8c-cfe3-4964-9447-7c0c4e5741da tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:10.139273 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e00bbe8c-cfe3-4964-9447-7c0c4e5741da tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:10.139697 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e00bbe8c-cfe3-4964-9447-7c0c4e5741da tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:10.165779 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-e00bbe8c-cfe3-4964-9447-7c0c4e5741da tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] [instance: 7138c016-225d-473e-9a66-b91fe89618eb] Going to try to terminate instance {{(pid=124726) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:59:10.510756 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-e00bbe8c-cfe3-4964-9447-7c0c4e5741da tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] 10.222.0.57 "DELETE /compute/v2.1/servers/7138c016-225d-473e-9a66-b91fe89618eb" status: 204 len: 0 microversion: 2.1 time: 0.385654 Aug 09 18:59:10.511349 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 521/1074] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 9 18:59:10 2022] DELETE /compute/v2.1/servers/7138c016-225d-473e-9a66-b91fe89618eb => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:59:10.520599 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-cdb38b6f-1830-49a4-805a-c1bc1351b5f2 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:59:10.524664 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-cdb38b6f-1830-49a4-805a-c1bc1351b5f2 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] [instance: 7138c016-225d-473e-9a66-b91fe89618eb] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:59:10.527238 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cdb38b6f-1830-49a4-805a-c1bc1351b5f2 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:10.527719 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cdb38b6f-1830-49a4-805a-c1bc1351b5f2 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:10.528152 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cdb38b6f-1830-49a4-805a-c1bc1351b5f2 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:10.528866 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cdb38b6f-1830-49a4-805a-c1bc1351b5f2 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:10.529320 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cdb38b6f-1830-49a4-805a-c1bc1351b5f2 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:10.529775 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cdb38b6f-1830-49a4-805a-c1bc1351b5f2 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:10.678008 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-cdb38b6f-1830-49a4-805a-c1bc1351b5f2 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4869cb3da4044b1dbc2b4f81a9c24607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a19ee530074672936cd7f57f1b4b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:59:10.688393 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-cdb38b6f-1830-49a4-805a-c1bc1351b5f2 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] 10.222.0.57 "GET /compute/v2.1/servers/7138c016-225d-473e-9a66-b91fe89618eb" status: 200 len: 1471 microversion: 2.1 time: 0.171713 Aug 09 18:59:10.689256 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 554/1075] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:59:10 2022] GET /compute/v2.1/servers/7138c016-225d-473e-9a66-b91fe89618eb => generated 1471 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:11.711123 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-f7ed3c37-83c1-43ed-b60e-9758f4a0fde0 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:59:11.713723 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-f7ed3c37-83c1-43ed-b60e-9758f4a0fde0 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] [instance: 7138c016-225d-473e-9a66-b91fe89618eb] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:59:11.719946 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f7ed3c37-83c1-43ed-b60e-9758f4a0fde0 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:11.720415 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f7ed3c37-83c1-43ed-b60e-9758f4a0fde0 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:11.720855 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f7ed3c37-83c1-43ed-b60e-9758f4a0fde0 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:11.721562 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f7ed3c37-83c1-43ed-b60e-9758f4a0fde0 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:11.722022 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f7ed3c37-83c1-43ed-b60e-9758f4a0fde0 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:11.722445 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f7ed3c37-83c1-43ed-b60e-9758f4a0fde0 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:11.864091 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-f7ed3c37-83c1-43ed-b60e-9758f4a0fde0 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4869cb3da4044b1dbc2b4f81a9c24607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a19ee530074672936cd7f57f1b4b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:59:11.871850 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-f7ed3c37-83c1-43ed-b60e-9758f4a0fde0 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] 10.222.0.57 "GET /compute/v2.1/servers/7138c016-225d-473e-9a66-b91fe89618eb" status: 200 len: 1471 microversion: 2.1 time: 0.165021 Aug 09 18:59:11.873295 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 522/1076] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:59:11 2022] GET /compute/v2.1/servers/7138c016-225d-473e-9a66-b91fe89618eb => generated 1471 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:12.892897 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-59d88fe7-e9de-4782-8af5-6c1e84037298 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:59:12.893510 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-59d88fe7-e9de-4782-8af5-6c1e84037298 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] [instance: 7138c016-225d-473e-9a66-b91fe89618eb] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:59:12.900424 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-59d88fe7-e9de-4782-8af5-6c1e84037298 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:12.900914 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-59d88fe7-e9de-4782-8af5-6c1e84037298 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:12.901603 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-59d88fe7-e9de-4782-8af5-6c1e84037298 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:12.902345 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-59d88fe7-e9de-4782-8af5-6c1e84037298 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:12.902994 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-59d88fe7-e9de-4782-8af5-6c1e84037298 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:12.903972 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-59d88fe7-e9de-4782-8af5-6c1e84037298 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:12.925350 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=100 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:13.054755 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-59d88fe7-e9de-4782-8af5-6c1e84037298 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4869cb3da4044b1dbc2b4f81a9c24607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a19ee530074672936cd7f57f1b4b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:59:13.063127 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-59d88fe7-e9de-4782-8af5-6c1e84037298 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] 10.222.0.57 "GET /compute/v2.1/servers/7138c016-225d-473e-9a66-b91fe89618eb" status: 200 len: 1471 microversion: 2.1 time: 0.174138 Aug 09 18:59:13.063833 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 555/1077] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:59:12 2022] GET /compute/v2.1/servers/7138c016-225d-473e-9a66-b91fe89618eb => generated 1471 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:59:13.926253 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-92ba8648-424f-47da-8b9b-48a8163b3e6e req-6f1480f7-b342-4796-ac5b-b6078fad93e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7138c016-225d-473e-9a66-b91fe89618eb", "name": "network-vif-deleted", "tag": "5f85d145-ebaf-48f3-bc05-e1db74c4f2c9"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:59:13.943436 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-92ba8648-424f-47da-8b9b-48a8163b3e6e req-6f1480f7-b342-4796-ac5b-b6078fad93e7 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:13.944124 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-92ba8648-424f-47da-8b9b-48a8163b3e6e req-6f1480f7-b342-4796-ac5b-b6078fad93e7 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:13.944826 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-92ba8648-424f-47da-8b9b-48a8163b3e6e req-6f1480f7-b342-4796-ac5b-b6078fad93e7 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:13.961205 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-92ba8648-424f-47da-8b9b-48a8163b3e6e req-6f1480f7-b342-4796-ac5b-b6078fad93e7 service nova] Creating event network-vif-deleted:5f85d145-ebaf-48f3-bc05-e1db74c4f2c9 for instance 7138c016-225d-473e-9a66-b91fe89618eb on hv-cinder-82660 Aug 09 18:59:13.966645 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-92ba8648-424f-47da-8b9b-48a8163b3e6e req-6f1480f7-b342-4796-ac5b-b6078fad93e7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044557 Aug 09 18:59:13.967859 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 523/1078] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:59:14.086638 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-626168bc-735b-4157-89df-0b1cfa9e2e2f tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:59:14.087264 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-626168bc-735b-4157-89df-0b1cfa9e2e2f tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] [instance: 7138c016-225d-473e-9a66-b91fe89618eb] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:59:14.094345 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-626168bc-735b-4157-89df-0b1cfa9e2e2f tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:14.094833 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-626168bc-735b-4157-89df-0b1cfa9e2e2f tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:14.095273 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-626168bc-735b-4157-89df-0b1cfa9e2e2f tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:14.095969 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-626168bc-735b-4157-89df-0b1cfa9e2e2f tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:14.100384 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-626168bc-735b-4157-89df-0b1cfa9e2e2f tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:14.100876 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-626168bc-735b-4157-89df-0b1cfa9e2e2f tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:14.166521 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-626168bc-735b-4157-89df-0b1cfa9e2e2f tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4869cb3da4044b1dbc2b4f81a9c24607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a19ee530074672936cd7f57f1b4b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:59:14.175085 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-626168bc-735b-4157-89df-0b1cfa9e2e2f tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] 10.222.0.57 "GET /compute/v2.1/servers/7138c016-225d-473e-9a66-b91fe89618eb" status: 200 len: 1300 microversion: 2.1 time: 0.092375 Aug 09 18:59:14.175870 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 556/1079] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:59:14 2022] GET /compute/v2.1/servers/7138c016-225d-473e-9a66-b91fe89618eb => generated 1300 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:15.197516 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-f56cb5d8-a229-4441-b8f3-481ffa8b4838 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:59:15.198244 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-f56cb5d8-a229-4441-b8f3-481ffa8b4838 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] [instance: 7138c016-225d-473e-9a66-b91fe89618eb] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:59:15.208085 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f56cb5d8-a229-4441-b8f3-481ffa8b4838 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:15.208655 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f56cb5d8-a229-4441-b8f3-481ffa8b4838 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:15.209096 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f56cb5d8-a229-4441-b8f3-481ffa8b4838 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:15.210208 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f56cb5d8-a229-4441-b8f3-481ffa8b4838 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:15.210680 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f56cb5d8-a229-4441-b8f3-481ffa8b4838 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:15.211205 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f56cb5d8-a229-4441-b8f3-481ffa8b4838 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:15.323896 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-f56cb5d8-a229-4441-b8f3-481ffa8b4838 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4869cb3da4044b1dbc2b4f81a9c24607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a19ee530074672936cd7f57f1b4b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:59:15.327633 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:15.332238 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-f56cb5d8-a229-4441-b8f3-481ffa8b4838 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] 10.222.0.57 "GET /compute/v2.1/servers/7138c016-225d-473e-9a66-b91fe89618eb" status: 200 len: 1300 microversion: 2.1 time: 0.139408 Aug 09 18:59:15.345772 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 524/1080] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:59:15 2022] GET /compute/v2.1/servers/7138c016-225d-473e-9a66-b91fe89618eb => generated 1300 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:16.355283 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e92f14af-29cc-48bc-a186-9446e045345e tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:59:16.356193 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e92f14af-29cc-48bc-a186-9446e045345e tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] [instance: 7138c016-225d-473e-9a66-b91fe89618eb] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:59:16.362307 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e92f14af-29cc-48bc-a186-9446e045345e tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:16.362936 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e92f14af-29cc-48bc-a186-9446e045345e tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:16.363472 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e92f14af-29cc-48bc-a186-9446e045345e tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:16.364266 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e92f14af-29cc-48bc-a186-9446e045345e tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:16.364834 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e92f14af-29cc-48bc-a186-9446e045345e tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:16.365356 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e92f14af-29cc-48bc-a186-9446e045345e tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:16.436467 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e92f14af-29cc-48bc-a186-9446e045345e tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4869cb3da4044b1dbc2b4f81a9c24607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a19ee530074672936cd7f57f1b4b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:59:16.444860 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e92f14af-29cc-48bc-a186-9446e045345e tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] 10.222.0.57 "GET /compute/v2.1/servers/7138c016-225d-473e-9a66-b91fe89618eb" status: 200 len: 1300 microversion: 2.1 time: 0.093649 Aug 09 18:59:16.445587 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 557/1081] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:59:16 2022] GET /compute/v2.1/servers/7138c016-225d-473e-9a66-b91fe89618eb => generated 1300 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:17.468327 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-b32c9113-3bde-4997-8097-62bd84b6b5ca tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:59:17.469811 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-b32c9113-3bde-4997-8097-62bd84b6b5ca tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] [instance: 7138c016-225d-473e-9a66-b91fe89618eb] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:59:17.473983 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:17.478354 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b32c9113-3bde-4997-8097-62bd84b6b5ca tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:17.478844 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b32c9113-3bde-4997-8097-62bd84b6b5ca tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:17.479538 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b32c9113-3bde-4997-8097-62bd84b6b5ca tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:17.480247 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b32c9113-3bde-4997-8097-62bd84b6b5ca tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:17.480833 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b32c9113-3bde-4997-8097-62bd84b6b5ca tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:17.481349 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b32c9113-3bde-4997-8097-62bd84b6b5ca tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:17.517171 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b32c9113-3bde-4997-8097-62bd84b6b5ca tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:17.517732 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b32c9113-3bde-4997-8097-62bd84b6b5ca tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:17.518323 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b32c9113-3bde-4997-8097-62bd84b6b5ca tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:17.518719 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.objects.instance [None req-b32c9113-3bde-4997-8097-62bd84b6b5ca tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lazy-loading 'fault' on Instance uuid 7138c016-225d-473e-9a66-b91fe89618eb {{(pid=124726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:59:17.579056 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-b32c9113-3bde-4997-8097-62bd84b6b5ca tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4869cb3da4044b1dbc2b4f81a9c24607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a19ee530074672936cd7f57f1b4b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:59:17.587976 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-b32c9113-3bde-4997-8097-62bd84b6b5ca tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] 10.222.0.57 "GET /compute/v2.1/servers/7138c016-225d-473e-9a66-b91fe89618eb" status: 200 len: 1305 microversion: 2.1 time: 0.124860 Aug 09 18:59:17.588634 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 525/1082] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:59:17 2022] GET /compute/v2.1/servers/7138c016-225d-473e-9a66-b91fe89618eb => generated 1305 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:18.612829 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-39ce84c0-1be1-49cb-a16b-5c6f00c84441 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:59:18.613451 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-39ce84c0-1be1-49cb-a16b-5c6f00c84441 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] [instance: 7138c016-225d-473e-9a66-b91fe89618eb] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:59:18.624544 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-39ce84c0-1be1-49cb-a16b-5c6f00c84441 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:18.625040 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-39ce84c0-1be1-49cb-a16b-5c6f00c84441 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:18.625474 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-39ce84c0-1be1-49cb-a16b-5c6f00c84441 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:18.626609 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-39ce84c0-1be1-49cb-a16b-5c6f00c84441 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:18.627230 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-39ce84c0-1be1-49cb-a16b-5c6f00c84441 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:18.627943 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-39ce84c0-1be1-49cb-a16b-5c6f00c84441 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:18.642602 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-39ce84c0-1be1-49cb-a16b-5c6f00c84441 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] HTTP exception thrown: Instance 7138c016-225d-473e-9a66-b91fe89618eb could not be found. Aug 09 18:59:18.644275 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-39ce84c0-1be1-49cb-a16b-5c6f00c84441 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Request method failure captured: Aug 09 18:59:18.644275 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: request: GET /compute/v2.1/servers/7138c016-225d-473e-9a66-b91fe89618eb HTTP/1.1 Aug 09 18:59:18.644275 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept: application/json Aug 09 18:59:18.644275 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Aug 09 18:59:18.644275 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Connection: close Aug 09 18:59:18.644275 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Length: 0 Aug 09 18:59:18.644275 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Type: application/json Aug 09 18:59:18.644275 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Host: 10.222.0.57 Aug 09 18:59:18.644275 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Aug 09 18:59:18.644275 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.11 Aug 09 18:59:18.644275 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABi8q5rWEvadkhZn5cWF1mv5lr_-zwpb16rxOnUaNUX1bo0Ys6IiCwImEORZFnK8dWVMB2tr8U9ea0ie_R6-f8eAq0vu2tIeAbh5v1KfuBl63v5SXWyNiOIcmiglCLwJr04Xy1iu2JPlCOUg6rVK3-r4mOujpf-2B8Z8_942G-_BxyBr6c Aug 09 18:59:18.644275 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Aug 09 18:59:18.644275 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Aug 09 18:59:18.644275 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Aug 09 18:59:18.644275 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Aug 09 18:59:18.644275 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Aug 09 18:59:18.644275 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Aug 09 18:59:18.644275 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Id: 86a19ee530074672936cd7f57f1b4b84 Aug 09 18:59:18.644275 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-VolumesNegativeTest-819565143 Aug 09 18:59:18.644275 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Role: reader,member Aug 09 18:59:18.644275 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Roles: reader,member Aug 09 18:59:18.646065 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_86a19ee530074672936cd7f57f1b4b84", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/86a19ee530074672936cd7f57f1b4b84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/86a19ee530074672936cd7f57f1b4b84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/86a19ee530074672936cd7f57f1b4b84"}]}] Aug 09 18:59:18.646065 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-VolumesNegativeTest-819565143 Aug 09 18:59:18.646065 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 86a19ee530074672936cd7f57f1b4b84 Aug 09 18:59:18.646065 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-VolumesNegativeTest-819565143 Aug 09 18:59:18.646065 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User: tempest-VolumesNegativeTest-819565143-project Aug 09 18:59:18.646065 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Aug 09 18:59:18.646065 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Aug 09 18:59:18.646065 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Id: 4869cb3da4044b1dbc2b4f81a9c24607 Aug 09 18:59:18.646065 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-VolumesNegativeTest-819565143-project Aug 09 18:59:18.646065 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: method: > Aug 09 18:59:18.646065 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: exception: Instance 7138c016-225d-473e-9a66-b91fe89618eb could not be found. Aug 09 18:59:18.646065 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: action_args: {'id': '7138c016-225d-473e-9a66-b91fe89618eb'} Aug 09 18:59:18.647167 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:59:18.647167 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:59:18.647167 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:59:18.647167 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:59:18.647167 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:59:18.647167 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:59:18.647167 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:59:18.647167 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:59:18.647167 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:59:18.647167 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:59:18.647167 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7138c016-225d-473e-9a66-b91fe89618eb could not be found. Aug 09 18:59:18.647167 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:59:18.647167 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:59:18.647167 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:59:18.647167 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:59:18.647167 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:59:18.647167 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:59:18.647167 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:59:18.647167 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:59:18.647167 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:59:18.648723 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:59:18.648723 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:59:18.648723 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:59:18.648723 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:59:18.648723 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:59:18.648723 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:59:18.648723 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:59:18.648723 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7138c016-225d-473e-9a66-b91fe89618eb could not be found. Aug 09 18:59:18.648723 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:59:18.648723 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:59:18.648723 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:59:18.648723 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:59:18.648723 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:59:18.648723 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:59:18.648723 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:59:18.648723 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:59:18.648723 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7138c016-225d-473e-9a66-b91fe89618eb could not be found. Aug 09 18:59:18.648723 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 18:59:18.650142 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-39ce84c0-1be1-49cb-a16b-5c6f00c84441 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] Returning 404 to user: Instance 7138c016-225d-473e-9a66-b91fe89618eb could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:59:18.650142 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-39ce84c0-1be1-49cb-a16b-5c6f00c84441 tempest-VolumesNegativeTest-819565143 tempest-VolumesNegativeTest-819565143-project] 10.222.0.57 "GET /compute/v2.1/servers/7138c016-225d-473e-9a66-b91fe89618eb" status: 404 len: 111 microversion: 2.1 time: 0.036606 Aug 09 18:59:18.650142 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 558/1083] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:59:18 2022] GET /compute/v2.1/servers/7138c016-225d-473e-9a66-b91fe89618eb => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:59:25.563915 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-fb069076-8bea-48a5-821c-2c71b9ea7786 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Action: 'create', calling method: .version_select at 0x7f8d69cee940>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-155422797", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATpwu0SjFNFRPBLKd+V41hDQa4lCWdj7PS//uP7Ty+pRGtCv8nh6tDOUrwTU4/IzCouq+0f30c45rBDgXTZk7o/+c4gHBZqPevSVYx0C9eMMwFx52gyGI6XVHrKFUn4fw=="}} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:59:25.585308 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.quota [None req-fb069076-8bea-48a5-821c-2c71b9ea7786 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Getting quotas for project 098c57b11d7948c8a1ef732af98ec75f. Resources: {'key_pairs'} {{(pid=124726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:59:25.595087 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.quota [None req-fb069076-8bea-48a5-821c-2c71b9ea7786 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Getting quotas for user dbed10f27ab548809755b32d0456d1bc and project 098c57b11d7948c8a1ef732af98ec75f. Resources: {'key_pairs'} {{(pid=124726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:59:25.741270 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-fb069076-8bea-48a5-821c-2c71b9ea7786 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.370052 Aug 09 18:59:25.742144 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 526/1084] 10.222.0.57 () {60 vars in 1159 bytes} [Tue Aug 9 18:59:25 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:59:44.564402 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c4b22ee4-6c6d-4014-ab35-da61bc64e3b9 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1687926201", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-155422797", "security_groups": [{"name": "tempest-secgroup-smoke-2002964655"}], "block_device_mapping_v2": [{"uuid": "8f747087-b7c4-4316-8a69-e7b1c71e3ec2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "20437699-6aec-4ae5-8d1b-64fe31f9d07b"}]}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:59:44.574557 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=48 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:44.575210 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=16 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:44.678337 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.network.neutron [None req-c4b22ee4-6c6d-4014-ab35-da61bc64e3b9 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] validate_networks() for [('20437699-6aec-4ae5-8d1b-64fe31f9d07b', None, None, None, None, None)] {{(pid=124725) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:59:45.053045 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-c4b22ee4-6c6d-4014-ab35-da61bc64e3b9 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Flavor limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:59:45.053467 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-c4b22ee4-6c6d-4014-ab35-da61bc64e3b9 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Image limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:59:45.054003 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-c4b22ee4-6c6d-4014-ab35-da61bc64e3b9 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Flavor pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:59:45.054413 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-c4b22ee4-6c6d-4014-ab35-da61bc64e3b9 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Image pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:59:45.054825 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-c4b22ee4-6c6d-4014-ab35-da61bc64e3b9 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:59:45.064127 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c4b22ee4-6c6d-4014-ab35-da61bc64e3b9 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:45.064606 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c4b22ee4-6c6d-4014-ab35-da61bc64e3b9 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:45.065041 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c4b22ee4-6c6d-4014-ab35-da61bc64e3b9 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:45.066064 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c4b22ee4-6c6d-4014-ab35-da61bc64e3b9 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:45.066518 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c4b22ee4-6c6d-4014-ab35-da61bc64e3b9 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:45.066943 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c4b22ee4-6c6d-4014-ab35-da61bc64e3b9 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:45.083945 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-c4b22ee4-6c6d-4014-ab35-da61bc64e3b9 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Getting quotas for project 098c57b11d7948c8a1ef732af98ec75f. Resources: {'cores', 'ram', 'instances'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:59:45.090699 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-c4b22ee4-6c6d-4014-ab35-da61bc64e3b9 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Getting quotas for user dbed10f27ab548809755b32d0456d1bc and project 098c57b11d7948c8a1ef732af98ec75f. Resources: {'cores', 'ram', 'instances'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:59:45.152484 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-c4b22ee4-6c6d-4014-ab35-da61bc64e3b9 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Going to run 1 instances... {{(pid=124725) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:59:45.154584 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-c4b22ee4-6c6d-4014-ab35-da61bc64e3b9 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 09500412-38e3-4e69-ac88-88ff4cbdb710] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8f747087-b7c4-4316-8a69-e7b1c71e3ec2',volume_size=None,volume_type=None)] {{(pid=124725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:59:45.557786 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-c4b22ee4-6c6d-4014-ab35-da61bc64e3b9 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.997844 Aug 09 18:59:45.558514 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 559/1085] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 9 18:59:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 999 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:59:45.569594 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-2ea6a4b6-c30a-4730-9421-c84ec665e522 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:59:45.570221 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-2ea6a4b6-c30a-4730-9421-c84ec665e522 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 09500412-38e3-4e69-ac88-88ff4cbdb710] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:59:45.572330 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell1:SELECT=8 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:45.573651 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell0:SELECT=4 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:45.574271 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:45.629105 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-2ea6a4b6-c30a-4730-9421-c84ec665e522 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:59:45.637366 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-2ea6a4b6-c30a-4730-9421-c84ec665e522 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710" status: 200 len: 1094 microversion: 2.1 time: 0.071982 Aug 09 18:59:45.637980 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 527/1086] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:59:45 2022] GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:46.658327 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b762eb70-7bcb-41b0-b334-c33193fab1cc tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:59:46.658951 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-b762eb70-7bcb-41b0-b334-c33193fab1cc tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 09500412-38e3-4e69-ac88-88ff4cbdb710] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:59:46.712456 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-b762eb70-7bcb-41b0-b334-c33193fab1cc tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:59:46.719075 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-b762eb70-7bcb-41b0-b334-c33193fab1cc tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710" status: 200 len: 1094 microversion: 2.1 time: 0.065176 Aug 09 18:59:46.719624 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 560/1087] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:59:46 2022] GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:47.743052 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-c6c17dfb-4c94-4fee-b87f-1d725ba76a7f tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:59:47.743682 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-c6c17dfb-4c94-4fee-b87f-1d725ba76a7f tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 09500412-38e3-4e69-ac88-88ff4cbdb710] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:59:47.751427 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c6c17dfb-4c94-4fee-b87f-1d725ba76a7f tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:47.751911 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c6c17dfb-4c94-4fee-b87f-1d725ba76a7f tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:47.752331 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c6c17dfb-4c94-4fee-b87f-1d725ba76a7f tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:47.753178 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c6c17dfb-4c94-4fee-b87f-1d725ba76a7f tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:47.753686 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c6c17dfb-4c94-4fee-b87f-1d725ba76a7f tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:47.754106 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c6c17dfb-4c94-4fee-b87f-1d725ba76a7f tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:47.848129 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-c6c17dfb-4c94-4fee-b87f-1d725ba76a7f tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:59:47.855538 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-c6c17dfb-4c94-4fee-b87f-1d725ba76a7f tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710" status: 200 len: 1200 microversion: 2.1 time: 0.116506 Aug 09 18:59:47.856128 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 528/1088] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:59:47 2022] GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710 => generated 1200 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:48.877311 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e7bcbb2b-a1e0-472c-a72f-435a339301af tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:59:48.878121 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e7bcbb2b-a1e0-472c-a72f-435a339301af tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 09500412-38e3-4e69-ac88-88ff4cbdb710] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:59:48.884608 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e7bcbb2b-a1e0-472c-a72f-435a339301af tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:48.885081 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e7bcbb2b-a1e0-472c-a72f-435a339301af tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:48.885511 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e7bcbb2b-a1e0-472c-a72f-435a339301af tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:48.886222 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e7bcbb2b-a1e0-472c-a72f-435a339301af tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:48.886667 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e7bcbb2b-a1e0-472c-a72f-435a339301af tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:48.887074 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e7bcbb2b-a1e0-472c-a72f-435a339301af tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:49.027074 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e7bcbb2b-a1e0-472c-a72f-435a339301af tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:59:49.038457 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e7bcbb2b-a1e0-472c-a72f-435a339301af tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710" status: 200 len: 1278 microversion: 2.1 time: 0.164892 Aug 09 18:59:49.039242 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 561/1089] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:59:48 2022] GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710 => generated 1278 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:49.567014 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-a8b69ee1-addb-4085-992a-9391ea1d7724 req-b84c119f-81e9-4d5a-83c8-2a52cc5787b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09500412-38e3-4e69-ac88-88ff4cbdb710", "tag": "d9936877-2702-402c-a44a-7911efcc9b68"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:59:49.576354 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-a8b69ee1-addb-4085-992a-9391ea1d7724 req-b84c119f-81e9-4d5a-83c8-2a52cc5787b3 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:49.576845 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-a8b69ee1-addb-4085-992a-9391ea1d7724 req-b84c119f-81e9-4d5a-83c8-2a52cc5787b3 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:49.577929 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-a8b69ee1-addb-4085-992a-9391ea1d7724 req-b84c119f-81e9-4d5a-83c8-2a52cc5787b3 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:49.589150 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-a8b69ee1-addb-4085-992a-9391ea1d7724 req-b84c119f-81e9-4d5a-83c8-2a52cc5787b3 service nova] Creating event network-changed:d9936877-2702-402c-a44a-7911efcc9b68 for instance 09500412-38e3-4e69-ac88-88ff4cbdb710 on hv-cinder-82660 Aug 09 18:59:49.594274 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-a8b69ee1-addb-4085-992a-9391ea1d7724 req-b84c119f-81e9-4d5a-83c8-2a52cc5787b3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031213 Aug 09 18:59:49.595058 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 529/1090] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 18:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:59:50.058708 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-89122962-0fb0-4df7-9c13-f07c6f91f31c tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:59:50.059353 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-89122962-0fb0-4df7-9c13-f07c6f91f31c tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 09500412-38e3-4e69-ac88-88ff4cbdb710] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:59:50.066135 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-89122962-0fb0-4df7-9c13-f07c6f91f31c tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:50.066650 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-89122962-0fb0-4df7-9c13-f07c6f91f31c tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:50.067091 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-89122962-0fb0-4df7-9c13-f07c6f91f31c tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:50.067788 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-89122962-0fb0-4df7-9c13-f07c6f91f31c tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:50.068244 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-89122962-0fb0-4df7-9c13-f07c6f91f31c tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:50.068669 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-89122962-0fb0-4df7-9c13-f07c6f91f31c tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:50.201065 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-89122962-0fb0-4df7-9c13-f07c6f91f31c tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:59:50.208912 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-89122962-0fb0-4df7-9c13-f07c6f91f31c tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710" status: 200 len: 1266 microversion: 2.1 time: 0.154034 Aug 09 18:59:50.209590 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 562/1091] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:59:50 2022] GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:51.235932 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-dc33dcf3-d6da-498d-ae2b-fd8751a6a280 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:59:51.236626 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-dc33dcf3-d6da-498d-ae2b-fd8751a6a280 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 09500412-38e3-4e69-ac88-88ff4cbdb710] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:59:51.242784 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-dc33dcf3-d6da-498d-ae2b-fd8751a6a280 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:51.243266 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-dc33dcf3-d6da-498d-ae2b-fd8751a6a280 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:51.243699 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-dc33dcf3-d6da-498d-ae2b-fd8751a6a280 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:51.244383 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-dc33dcf3-d6da-498d-ae2b-fd8751a6a280 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:51.244836 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-dc33dcf3-d6da-498d-ae2b-fd8751a6a280 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:51.245257 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-dc33dcf3-d6da-498d-ae2b-fd8751a6a280 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:51.380526 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-dc33dcf3-d6da-498d-ae2b-fd8751a6a280 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:59:51.387914 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-dc33dcf3-d6da-498d-ae2b-fd8751a6a280 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710" status: 200 len: 1266 microversion: 2.1 time: 0.157196 Aug 09 18:59:51.388486 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 530/1092] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:59:51 2022] GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:52.408333 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-50cde18e-76bd-423d-afb3-f7fb3bbbd966 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:59:52.408951 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-50cde18e-76bd-423d-afb3-f7fb3bbbd966 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 09500412-38e3-4e69-ac88-88ff4cbdb710] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:59:52.415328 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-50cde18e-76bd-423d-afb3-f7fb3bbbd966 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:52.415830 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-50cde18e-76bd-423d-afb3-f7fb3bbbd966 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:52.416251 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-50cde18e-76bd-423d-afb3-f7fb3bbbd966 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:52.416952 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-50cde18e-76bd-423d-afb3-f7fb3bbbd966 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:52.417608 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-50cde18e-76bd-423d-afb3-f7fb3bbbd966 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:52.417840 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-50cde18e-76bd-423d-afb3-f7fb3bbbd966 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:52.555333 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-50cde18e-76bd-423d-afb3-f7fb3bbbd966 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:59:52.563717 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-50cde18e-76bd-423d-afb3-f7fb3bbbd966 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710" status: 200 len: 1266 microversion: 2.1 time: 0.159373 Aug 09 18:59:52.564289 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 563/1093] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:59:52 2022] GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:53.584198 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-5a73655e-b4d7-4712-9f59-37a7ade083da tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:59:53.584808 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-5a73655e-b4d7-4712-9f59-37a7ade083da tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 09500412-38e3-4e69-ac88-88ff4cbdb710] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:59:53.591294 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5a73655e-b4d7-4712-9f59-37a7ade083da tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:53.591814 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5a73655e-b4d7-4712-9f59-37a7ade083da tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:53.592214 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5a73655e-b4d7-4712-9f59-37a7ade083da tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:53.593569 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5a73655e-b4d7-4712-9f59-37a7ade083da tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:53.594029 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5a73655e-b4d7-4712-9f59-37a7ade083da tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:53.594457 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-5a73655e-b4d7-4712-9f59-37a7ade083da tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:53.727711 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-5a73655e-b4d7-4712-9f59-37a7ade083da tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:59:53.735361 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-5a73655e-b4d7-4712-9f59-37a7ade083da tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710" status: 200 len: 1266 microversion: 2.1 time: 0.155049 Aug 09 18:59:53.735932 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 531/1094] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:59:53 2022] GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:54.755984 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d7ddda04-19c4-47d0-8d87-b10340055fb1 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:59:54.756597 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-d7ddda04-19c4-47d0-8d87-b10340055fb1 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 09500412-38e3-4e69-ac88-88ff4cbdb710] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:59:54.763068 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d7ddda04-19c4-47d0-8d87-b10340055fb1 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:54.765706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d7ddda04-19c4-47d0-8d87-b10340055fb1 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:54.765706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d7ddda04-19c4-47d0-8d87-b10340055fb1 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:54.765706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d7ddda04-19c4-47d0-8d87-b10340055fb1 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:54.765706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d7ddda04-19c4-47d0-8d87-b10340055fb1 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:54.766261 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d7ddda04-19c4-47d0-8d87-b10340055fb1 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:54.895182 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d7ddda04-19c4-47d0-8d87-b10340055fb1 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:59:54.902496 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-d7ddda04-19c4-47d0-8d87-b10340055fb1 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710" status: 200 len: 1266 microversion: 2.1 time: 0.150440 Aug 09 18:59:54.903056 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 564/1095] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:59:54 2022] GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:55.923194 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-b1bcd427-cb93-4e8b-bf7e-14b1ae784e72 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:59:55.923800 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-b1bcd427-cb93-4e8b-bf7e-14b1ae784e72 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 09500412-38e3-4e69-ac88-88ff4cbdb710] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:59:55.931206 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b1bcd427-cb93-4e8b-bf7e-14b1ae784e72 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:55.931680 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b1bcd427-cb93-4e8b-bf7e-14b1ae784e72 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:55.932106 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b1bcd427-cb93-4e8b-bf7e-14b1ae784e72 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:55.932793 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b1bcd427-cb93-4e8b-bf7e-14b1ae784e72 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:55.933238 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b1bcd427-cb93-4e8b-bf7e-14b1ae784e72 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:55.933693 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-b1bcd427-cb93-4e8b-bf7e-14b1ae784e72 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:56.064220 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-b1bcd427-cb93-4e8b-bf7e-14b1ae784e72 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:59:56.071890 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-b1bcd427-cb93-4e8b-bf7e-14b1ae784e72 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710" status: 200 len: 1266 microversion: 2.1 time: 0.152603 Aug 09 18:59:56.072466 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 532/1096] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:59:55 2022] GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:57.093408 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f2838249-9b10-4d31-a227-cfcf57ddbdb0 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:59:57.094040 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-f2838249-9b10-4d31-a227-cfcf57ddbdb0 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 09500412-38e3-4e69-ac88-88ff4cbdb710] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:59:57.095847 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=2 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:57.097005 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=8 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:57.101764 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f2838249-9b10-4d31-a227-cfcf57ddbdb0 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:57.104158 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f2838249-9b10-4d31-a227-cfcf57ddbdb0 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:57.104158 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f2838249-9b10-4d31-a227-cfcf57ddbdb0 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:57.104158 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f2838249-9b10-4d31-a227-cfcf57ddbdb0 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:57.104158 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f2838249-9b10-4d31-a227-cfcf57ddbdb0 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:57.104548 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f2838249-9b10-4d31-a227-cfcf57ddbdb0 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:57.239525 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f2838249-9b10-4d31-a227-cfcf57ddbdb0 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:59:57.246840 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f2838249-9b10-4d31-a227-cfcf57ddbdb0 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710" status: 200 len: 1266 microversion: 2.1 time: 0.157787 Aug 09 18:59:57.247404 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 565/1097] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:59:57 2022] GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:58.267935 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-0541484a-ef4d-4feb-bde0-2224a258b348 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:59:58.268484 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-0541484a-ef4d-4feb-bde0-2224a258b348 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 09500412-38e3-4e69-ac88-88ff4cbdb710] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:59:58.270868 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell0:SELECT=2 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:58.275623 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0541484a-ef4d-4feb-bde0-2224a258b348 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:58.276094 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0541484a-ef4d-4feb-bde0-2224a258b348 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:58.276518 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0541484a-ef4d-4feb-bde0-2224a258b348 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:58.277198 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0541484a-ef4d-4feb-bde0-2224a258b348 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:58.277678 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0541484a-ef4d-4feb-bde0-2224a258b348 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:58.278096 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-0541484a-ef4d-4feb-bde0-2224a258b348 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:58.412517 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-0541484a-ef4d-4feb-bde0-2224a258b348 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:59:58.419935 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-0541484a-ef4d-4feb-bde0-2224a258b348 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710" status: 200 len: 1266 microversion: 2.1 time: 0.155967 Aug 09 18:59:58.420582 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 533/1098] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:59:58 2022] GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:59.441385 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-8ae8c90e-7c9f-4ccd-b58d-308ab86ac299 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:59:59.442121 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-8ae8c90e-7c9f-4ccd-b58d-308ab86ac299 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 09500412-38e3-4e69-ac88-88ff4cbdb710] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:59:59.448460 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8ae8c90e-7c9f-4ccd-b58d-308ab86ac299 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:59.448934 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8ae8c90e-7c9f-4ccd-b58d-308ab86ac299 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:59.449358 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8ae8c90e-7c9f-4ccd-b58d-308ab86ac299 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:59.450074 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8ae8c90e-7c9f-4ccd-b58d-308ab86ac299 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:59:59.450519 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8ae8c90e-7c9f-4ccd-b58d-308ab86ac299 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:59:59.450934 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8ae8c90e-7c9f-4ccd-b58d-308ab86ac299 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:59:59.600055 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-8ae8c90e-7c9f-4ccd-b58d-308ab86ac299 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:59:59.607522 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-8ae8c90e-7c9f-4ccd-b58d-308ab86ac299 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710" status: 200 len: 1266 microversion: 2.1 time: 0.170289 Aug 09 18:59:59.608602 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 566/1099] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 18:59:59 2022] GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:00:00.628976 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-7212ef0d-7adf-40b4-8e4c-79588b32ef83 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:00:00.629666 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-7212ef0d-7adf-40b4-8e4c-79588b32ef83 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 09500412-38e3-4e69-ac88-88ff4cbdb710] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:00:00.636038 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7212ef0d-7adf-40b4-8e4c-79588b32ef83 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:00:00.636517 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7212ef0d-7adf-40b4-8e4c-79588b32ef83 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:00:00.636950 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7212ef0d-7adf-40b4-8e4c-79588b32ef83 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:00:00.637670 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7212ef0d-7adf-40b4-8e4c-79588b32ef83 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:00:00.638128 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7212ef0d-7adf-40b4-8e4c-79588b32ef83 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:00:00.638560 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7212ef0d-7adf-40b4-8e4c-79588b32ef83 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:00:00.768436 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-7212ef0d-7adf-40b4-8e4c-79588b32ef83 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:00:00.775939 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-7212ef0d-7adf-40b4-8e4c-79588b32ef83 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710" status: 200 len: 1266 microversion: 2.1 time: 0.150885 Aug 09 19:00:00.776501 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 534/1100] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:00:00 2022] GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:00:01.733662 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-d2365d3a-3acd-4116-bff6-117c4feb32d5 req-5e4d3ead-3d36-443d-ad67-089597d3c07a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09500412-38e3-4e69-ac88-88ff4cbdb710", "name": "network-vif-plugged", "status": "completed", "tag": "d9936877-2702-402c-a44a-7911efcc9b68"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:00:01.742944 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-d2365d3a-3acd-4116-bff6-117c4feb32d5 req-5e4d3ead-3d36-443d-ad67-089597d3c07a service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:00:01.743416 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-d2365d3a-3acd-4116-bff6-117c4feb32d5 req-5e4d3ead-3d36-443d-ad67-089597d3c07a service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:00:01.743843 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-d2365d3a-3acd-4116-bff6-117c4feb32d5 req-5e4d3ead-3d36-443d-ad67-089597d3c07a service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:00:01.757430 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-d2365d3a-3acd-4116-bff6-117c4feb32d5 req-5e4d3ead-3d36-443d-ad67-089597d3c07a service nova] Creating event network-vif-plugged:d9936877-2702-402c-a44a-7911efcc9b68 for instance 09500412-38e3-4e69-ac88-88ff4cbdb710 on hv-cinder-82660 Aug 09 19:00:01.762949 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-d2365d3a-3acd-4116-bff6-117c4feb32d5 req-5e4d3ead-3d36-443d-ad67-089597d3c07a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152484 Aug 09 19:00:01.763560 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 567/1101] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 19:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:00:01.797013 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-9bf22ddd-dcf6-434f-b46d-c30a607c540e tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:00:01.797670 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-9bf22ddd-dcf6-434f-b46d-c30a607c540e tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 09500412-38e3-4e69-ac88-88ff4cbdb710] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:00:01.804109 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9bf22ddd-dcf6-434f-b46d-c30a607c540e tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:00:01.804622 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9bf22ddd-dcf6-434f-b46d-c30a607c540e tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:00:01.805161 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9bf22ddd-dcf6-434f-b46d-c30a607c540e tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:00:01.805882 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9bf22ddd-dcf6-434f-b46d-c30a607c540e tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:00:01.806333 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9bf22ddd-dcf6-434f-b46d-c30a607c540e tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:00:01.806754 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9bf22ddd-dcf6-434f-b46d-c30a607c540e tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:00:01.949583 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-9bf22ddd-dcf6-434f-b46d-c30a607c540e tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:00:01.957361 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-9bf22ddd-dcf6-434f-b46d-c30a607c540e tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710" status: 200 len: 1266 microversion: 2.1 time: 0.164791 Aug 09 19:00:01.957985 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 535/1102] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:00:01 2022] GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:00:02.978694 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-031a4823-edd4-4cb4-b921-3cb5d40a207a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:00:02.979382 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-031a4823-edd4-4cb4-b921-3cb5d40a207a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 09500412-38e3-4e69-ac88-88ff4cbdb710] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:00:02.986586 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-031a4823-edd4-4cb4-b921-3cb5d40a207a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:00:02.987058 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-031a4823-edd4-4cb4-b921-3cb5d40a207a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:00:02.987484 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-031a4823-edd4-4cb4-b921-3cb5d40a207a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:00:02.988170 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-031a4823-edd4-4cb4-b921-3cb5d40a207a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:00:02.988621 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-031a4823-edd4-4cb4-b921-3cb5d40a207a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:00:02.989034 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-031a4823-edd4-4cb4-b921-3cb5d40a207a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:00:03.122604 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-031a4823-edd4-4cb4-b921-3cb5d40a207a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:00:03.130302 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-031a4823-edd4-4cb4-b921-3cb5d40a207a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710" status: 200 len: 1266 microversion: 2.1 time: 0.155798 Aug 09 19:00:03.133448 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 568/1103] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:00:02 2022] GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:00:04.150490 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-fc66ecc5-d216-43f3-ba77-5715b6f14af4 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:00:04.151099 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-fc66ecc5-d216-43f3-ba77-5715b6f14af4 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 09500412-38e3-4e69-ac88-88ff4cbdb710] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:00:04.158402 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fc66ecc5-d216-43f3-ba77-5715b6f14af4 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:00:04.158884 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fc66ecc5-d216-43f3-ba77-5715b6f14af4 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:00:04.159315 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fc66ecc5-d216-43f3-ba77-5715b6f14af4 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:00:04.160002 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fc66ecc5-d216-43f3-ba77-5715b6f14af4 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:00:04.160456 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fc66ecc5-d216-43f3-ba77-5715b6f14af4 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:00:04.160878 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-fc66ecc5-d216-43f3-ba77-5715b6f14af4 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:00:04.298578 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-fc66ecc5-d216-43f3-ba77-5715b6f14af4 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:00:04.306263 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-fc66ecc5-d216-43f3-ba77-5715b6f14af4 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710" status: 200 len: 1451 microversion: 2.1 time: 0.159764 Aug 09 19:00:04.306824 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 536/1104] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:00:04 2022] GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710 => generated 1451 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:00:04.327669 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e6c4bb1a-6e5a-4fa2-8a39-415c9d277819 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:00:04.332231 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e6c4bb1a-6e5a-4fa2-8a39-415c9d277819 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 09500412-38e3-4e69-ac88-88ff4cbdb710] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:00:04.334733 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e6c4bb1a-6e5a-4fa2-8a39-415c9d277819 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:00:04.335209 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e6c4bb1a-6e5a-4fa2-8a39-415c9d277819 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:00:04.335636 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e6c4bb1a-6e5a-4fa2-8a39-415c9d277819 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:00:04.336320 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e6c4bb1a-6e5a-4fa2-8a39-415c9d277819 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:00:04.336764 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e6c4bb1a-6e5a-4fa2-8a39-415c9d277819 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:00:04.337182 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e6c4bb1a-6e5a-4fa2-8a39-415c9d277819 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:00:04.470846 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e6c4bb1a-6e5a-4fa2-8a39-415c9d277819 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:00:04.478636 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e6c4bb1a-6e5a-4fa2-8a39-415c9d277819 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710" status: 200 len: 1451 microversion: 2.1 time: 0.155507 Aug 09 19:00:04.479196 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 569/1105] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:00:04 2022] GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:00:06.901196 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-ee78ea49-7b4e-4806-a231-459243021c77 req-6be50b55-cc31-4c62-8414-4986ac3f24f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09500412-38e3-4e69-ac88-88ff4cbdb710", "tag": "d9936877-2702-402c-a44a-7911efcc9b68"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:00:06.911983 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-ee78ea49-7b4e-4806-a231-459243021c77 req-6be50b55-cc31-4c62-8414-4986ac3f24f7 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:00:06.912466 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-ee78ea49-7b4e-4806-a231-459243021c77 req-6be50b55-cc31-4c62-8414-4986ac3f24f7 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:00:06.912942 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-ee78ea49-7b4e-4806-a231-459243021c77 req-6be50b55-cc31-4c62-8414-4986ac3f24f7 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:00:06.925295 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-ee78ea49-7b4e-4806-a231-459243021c77 req-6be50b55-cc31-4c62-8414-4986ac3f24f7 service nova] Creating event network-changed:d9936877-2702-402c-a44a-7911efcc9b68 for instance 09500412-38e3-4e69-ac88-88ff4cbdb710 on hv-cinder-82660 Aug 09 19:00:06.930681 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-ee78ea49-7b4e-4806-a231-459243021c77 req-6be50b55-cc31-4c62-8414-4986ac3f24f7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033190 Aug 09 19:00:06.931300 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 537/1106] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 19:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:02:04.509687 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR oslo.messaging._drivers.impl_rabbit [-] [87fc3980-7856-447b-b7f0-9a9fe94ed0c1] AMQP server on 10.222.0.57:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 09 19:02:04.512692 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:02:04.512692 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=52 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:02:04.514847 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-13c30524-c36f-4f9d-86fe-011191ed46f8 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:02:04.515333 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-13c30524-c36f-4f9d-86fe-011191ed46f8 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 09500412-38e3-4e69-ac88-88ff4cbdb710] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:02:04.521705 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-13c30524-c36f-4f9d-86fe-011191ed46f8 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:04.522124 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-13c30524-c36f-4f9d-86fe-011191ed46f8 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:04.522549 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-13c30524-c36f-4f9d-86fe-011191ed46f8 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:04.523230 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-13c30524-c36f-4f9d-86fe-011191ed46f8 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:04.523676 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-13c30524-c36f-4f9d-86fe-011191ed46f8 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:04.524125 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-13c30524-c36f-4f9d-86fe-011191ed46f8 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:04.548001 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-13c30524-c36f-4f9d-86fe-011191ed46f8 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 09500412-38e3-4e69-ac88-88ff4cbdb710] Going to try to terminate instance {{(pid=124725) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 19:02:04.785726 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-13c30524-c36f-4f9d-86fe-011191ed46f8 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "DELETE /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710" status: 204 len: 0 microversion: 2.1 time: 0.277892 Aug 09 19:02:04.786251 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 570/1107] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 9 19:02:04 2022] DELETE /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 19:02:04.792601 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5a0da0d8-3725-4dce-8527-91876721098c] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 09 19:02:04.793225 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_api:SELECT=24 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:02:04.794029 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell1:SELECT=52 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:02:04.798459 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-160a00e5-da92-4e5a-9b86-7fba2c778a0b tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:02:04.799170 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-160a00e5-da92-4e5a-9b86-7fba2c778a0b tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 09500412-38e3-4e69-ac88-88ff4cbdb710] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:02:04.805207 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-160a00e5-da92-4e5a-9b86-7fba2c778a0b tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:04.805735 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-160a00e5-da92-4e5a-9b86-7fba2c778a0b tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:04.806172 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-160a00e5-da92-4e5a-9b86-7fba2c778a0b tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:04.806862 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-160a00e5-da92-4e5a-9b86-7fba2c778a0b tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:04.807314 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-160a00e5-da92-4e5a-9b86-7fba2c778a0b tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:04.807738 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-160a00e5-da92-4e5a-9b86-7fba2c778a0b tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:04.941717 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-160a00e5-da92-4e5a-9b86-7fba2c778a0b tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:02:04.950626 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-160a00e5-da92-4e5a-9b86-7fba2c778a0b tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710" status: 200 len: 1576 microversion: 2.1 time: 0.159906 Aug 09 19:02:04.951186 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 538/1108] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:02:04 2022] GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:02:05.972561 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-00200b71-806a-4a7f-a46d-4e3d5bb4e2ed tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:02:05.973162 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-00200b71-806a-4a7f-a46d-4e3d5bb4e2ed tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 09500412-38e3-4e69-ac88-88ff4cbdb710] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:02:05.980180 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-00200b71-806a-4a7f-a46d-4e3d5bb4e2ed tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:05.980730 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-00200b71-806a-4a7f-a46d-4e3d5bb4e2ed tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:05.981156 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-00200b71-806a-4a7f-a46d-4e3d5bb4e2ed tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:05.981877 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-00200b71-806a-4a7f-a46d-4e3d5bb4e2ed tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:05.982320 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-00200b71-806a-4a7f-a46d-4e3d5bb4e2ed tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:05.982734 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-00200b71-806a-4a7f-a46d-4e3d5bb4e2ed tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:05.988618 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO oslo.messaging._drivers.impl_rabbit [-] [87fc3980-7856-447b-b7f0-9a9fe94ed0c1] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 54708. Aug 09 19:02:06.117920 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-00200b71-806a-4a7f-a46d-4e3d5bb4e2ed tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:02:06.125504 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-00200b71-806a-4a7f-a46d-4e3d5bb4e2ed tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710" status: 200 len: 1576 microversion: 2.1 time: 0.157314 Aug 09 19:02:06.126087 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 571/1109] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:02:05 2022] GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:02:07.146957 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-f8315978-3b4c-4073-ae56-4ecc0e6f8cfa tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:02:07.147581 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-f8315978-3b4c-4073-ae56-4ecc0e6f8cfa tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 09500412-38e3-4e69-ac88-88ff4cbdb710] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:02:07.155392 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f8315978-3b4c-4073-ae56-4ecc0e6f8cfa tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:07.155811 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f8315978-3b4c-4073-ae56-4ecc0e6f8cfa tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:07.156246 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f8315978-3b4c-4073-ae56-4ecc0e6f8cfa tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:07.156947 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f8315978-3b4c-4073-ae56-4ecc0e6f8cfa tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:07.157405 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f8315978-3b4c-4073-ae56-4ecc0e6f8cfa tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:07.157860 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-f8315978-3b4c-4073-ae56-4ecc0e6f8cfa tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:07.163331 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO oslo.messaging._drivers.impl_rabbit [-] [5a0da0d8-3725-4dce-8527-91876721098c] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 54714. Aug 09 19:02:07.248724 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-f8315978-3b4c-4073-ae56-4ecc0e6f8cfa tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:02:07.257120 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-f8315978-3b4c-4073-ae56-4ecc0e6f8cfa tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710" status: 200 len: 1508 microversion: 2.1 time: 0.114639 Aug 09 19:02:07.257729 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 539/1110] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:02:07 2022] GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710 => generated 1508 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:02:07.305495 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-023608bd-413b-42c4-989c-6bc9cff76d21 req-6a9d8d6a-f08c-4eeb-819c-fedde49cb815 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09500412-38e3-4e69-ac88-88ff4cbdb710", "name": "network-vif-deleted", "tag": "d9936877-2702-402c-a44a-7911efcc9b68"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:02:07.315614 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-023608bd-413b-42c4-989c-6bc9cff76d21 req-6a9d8d6a-f08c-4eeb-819c-fedde49cb815 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:07.319284 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-023608bd-413b-42c4-989c-6bc9cff76d21 req-6a9d8d6a-f08c-4eeb-819c-fedde49cb815 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:07.319284 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-023608bd-413b-42c4-989c-6bc9cff76d21 req-6a9d8d6a-f08c-4eeb-819c-fedde49cb815 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:07.329170 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-023608bd-413b-42c4-989c-6bc9cff76d21 req-6a9d8d6a-f08c-4eeb-819c-fedde49cb815 service nova] Creating event network-vif-deleted:d9936877-2702-402c-a44a-7911efcc9b68 for instance 09500412-38e3-4e69-ac88-88ff4cbdb710 on hv-cinder-82660 Aug 09 19:02:07.334410 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-023608bd-413b-42c4-989c-6bc9cff76d21 req-6a9d8d6a-f08c-4eeb-819c-fedde49cb815 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090713 Aug 09 19:02:07.335233 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 572/1111] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 19:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:02:08.278698 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-85e376e6-eb5c-4837-b315-45919385901e tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:02:08.279393 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-85e376e6-eb5c-4837-b315-45919385901e tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 09500412-38e3-4e69-ac88-88ff4cbdb710] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:02:08.286105 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-85e376e6-eb5c-4837-b315-45919385901e tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:08.291653 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-85e376e6-eb5c-4837-b315-45919385901e tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:08.291653 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-85e376e6-eb5c-4837-b315-45919385901e tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:08.291653 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-85e376e6-eb5c-4837-b315-45919385901e tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:08.291653 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-85e376e6-eb5c-4837-b315-45919385901e tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:08.292167 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-85e376e6-eb5c-4837-b315-45919385901e tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:08.321215 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-85e376e6-eb5c-4837-b315-45919385901e tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:08.321738 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-85e376e6-eb5c-4837-b315-45919385901e tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:08.322168 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-85e376e6-eb5c-4837-b315-45919385901e tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:08.322608 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.objects.instance [None req-85e376e6-eb5c-4837-b315-45919385901e tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lazy-loading 'fault' on Instance uuid 09500412-38e3-4e69-ac88-88ff4cbdb710 {{(pid=124726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 19:02:08.364229 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-85e376e6-eb5c-4837-b315-45919385901e tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:02:08.372019 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-85e376e6-eb5c-4837-b315-45919385901e tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710" status: 200 len: 1230 microversion: 2.1 time: 0.097450 Aug 09 19:02:08.372596 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 540/1112] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:02:08 2022] GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710 => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:02:09.394571 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-3de2fdfb-3c02-4edd-9172-737fadff7e43 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:02:09.395259 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-3de2fdfb-3c02-4edd-9172-737fadff7e43 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 09500412-38e3-4e69-ac88-88ff4cbdb710] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:02:09.401438 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3de2fdfb-3c02-4edd-9172-737fadff7e43 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:09.401963 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3de2fdfb-3c02-4edd-9172-737fadff7e43 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:09.402393 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3de2fdfb-3c02-4edd-9172-737fadff7e43 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:09.403185 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3de2fdfb-3c02-4edd-9172-737fadff7e43 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:09.403514 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3de2fdfb-3c02-4edd-9172-737fadff7e43 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:09.404004 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3de2fdfb-3c02-4edd-9172-737fadff7e43 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:09.417752 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-3de2fdfb-3c02-4edd-9172-737fadff7e43 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] HTTP exception thrown: Instance 09500412-38e3-4e69-ac88-88ff4cbdb710 could not be found. Aug 09 19:02:09.419347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-3de2fdfb-3c02-4edd-9172-737fadff7e43 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Request method failure captured: Aug 09 19:02:09.419347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: request: GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710 HTTP/1.1 Aug 09 19:02:09.419347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept: application/json Aug 09 19:02:09.419347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Aug 09 19:02:09.419347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Connection: close Aug 09 19:02:09.419347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Length: 0 Aug 09 19:02:09.419347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Type: application/json Aug 09 19:02:09.419347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Host: 10.222.0.57 Aug 09 19:02:09.419347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Aug 09 19:02:09.419347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.11 Aug 09 19:02:09.419347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABi8q6GJR2EhH1Kr2xEKpP0-jVqEMC8I7Ee7gctxgNP-ikGjM2fAZohTB_9B3m3ZUpyPCJOzp2JgMc2cz1cMu4G3LOZLO6V-GEar4TwrNte3T79zpeBdEyKPpRd39t6HpDhn2XbYgxEwuN_tMWkPRUXYBHedYpSe0cf_X4srkv2OVDds8w Aug 09 19:02:09.419347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Aug 09 19:02:09.419347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Aug 09 19:02:09.419347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Aug 09 19:02:09.419347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Aug 09 19:02:09.419347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Aug 09 19:02:09.419347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Aug 09 19:02:09.419347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Id: 098c57b11d7948c8a1ef732af98ec75f Aug 09 19:02:09.419347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-TestVolumeBootPattern-1500127689 Aug 09 19:02:09.419347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Role: reader,member Aug 09 19:02:09.419347 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Roles: reader,member Aug 09 19:02:09.421157 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_098c57b11d7948c8a1ef732af98ec75f", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/098c57b11d7948c8a1ef732af98ec75f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/098c57b11d7948c8a1ef732af98ec75f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/098c57b11d7948c8a1ef732af98ec75f"}]}] Aug 09 19:02:09.421157 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-TestVolumeBootPattern-1500127689 Aug 09 19:02:09.421157 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 098c57b11d7948c8a1ef732af98ec75f Aug 09 19:02:09.421157 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-TestVolumeBootPattern-1500127689 Aug 09 19:02:09.421157 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User: tempest-TestVolumeBootPattern-1500127689-project Aug 09 19:02:09.421157 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Aug 09 19:02:09.421157 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Aug 09 19:02:09.421157 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Id: dbed10f27ab548809755b32d0456d1bc Aug 09 19:02:09.421157 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-TestVolumeBootPattern-1500127689-project Aug 09 19:02:09.421157 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: method: > Aug 09 19:02:09.421157 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: exception: Instance 09500412-38e3-4e69-ac88-88ff4cbdb710 could not be found. Aug 09 19:02:09.421157 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: action_args: {'id': '09500412-38e3-4e69-ac88-88ff4cbdb710'} Aug 09 19:02:09.422322 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:02:09.422322 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:02:09.422322 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:02:09.422322 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:02:09.422322 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:02:09.422322 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:02:09.422322 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:02:09.422322 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:02:09.422322 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:02:09.422322 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:02:09.422322 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09500412-38e3-4e69-ac88-88ff4cbdb710 could not be found. Aug 09 19:02:09.422322 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 19:02:09.422322 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:02:09.422322 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 19:02:09.422322 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:02:09.422322 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:02:09.422322 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:02:09.422322 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:02:09.422322 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:02:09.422322 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:02:09.423991 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:02:09.423991 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 19:02:09.423991 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 19:02:09.423991 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:02:09.423991 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:02:09.423991 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:02:09.423991 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:02:09.423991 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09500412-38e3-4e69-ac88-88ff4cbdb710 could not be found. Aug 09 19:02:09.423991 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 19:02:09.423991 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:02:09.423991 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 19:02:09.423991 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:02:09.423991 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:02:09.423991 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:02:09.423991 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:02:09.423991 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:02:09.423991 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09500412-38e3-4e69-ac88-88ff4cbdb710 could not be found. Aug 09 19:02:09.423991 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 19:02:09.425462 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-3de2fdfb-3c02-4edd-9172-737fadff7e43 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Returning 404 to user: Instance 09500412-38e3-4e69-ac88-88ff4cbdb710 could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:02:09.425462 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-3de2fdfb-3c02-4edd-9172-737fadff7e43 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710" status: 404 len: 111 microversion: 2.1 time: 0.030952 Aug 09 19:02:09.425462 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 573/1113] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:02:09 2022] GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:02:09.469113 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-d3f5685c-45af-4326-ac74-0d98b2c630ce tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1475705236", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-155422797", "security_groups": [{"name": "tempest-secgroup-smoke-2002964655"}], "block_device_mapping_v2": [{"uuid": "8f747087-b7c4-4316-8a69-e7b1c71e3ec2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "20437699-6aec-4ae5-8d1b-64fe31f9d07b"}]}} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:02:09.585175 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.network.neutron [None req-d3f5685c-45af-4326-ac74-0d98b2c630ce tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] validate_networks() for [('20437699-6aec-4ae5-8d1b-64fe31f9d07b', None, None, None, None, None)] {{(pid=124726) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 19:02:09.998869 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.virt.hardware [None req-d3f5685c-45af-4326-ac74-0d98b2c630ce tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Flavor limits 0:0:0 {{(pid=124726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 19:02:09.999294 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.virt.hardware [None req-d3f5685c-45af-4326-ac74-0d98b2c630ce tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Image limits 0:0:0 {{(pid=124726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 19:02:09.999840 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.virt.hardware [None req-d3f5685c-45af-4326-ac74-0d98b2c630ce tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Flavor pref 0:0:0 {{(pid=124726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 19:02:10.000263 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.virt.hardware [None req-d3f5685c-45af-4326-ac74-0d98b2c630ce tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Image pref 0:0:0 {{(pid=124726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 19:02:10.000675 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.virt.hardware [None req-d3f5685c-45af-4326-ac74-0d98b2c630ce tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 19:02:10.009412 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d3f5685c-45af-4326-ac74-0d98b2c630ce tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:10.012160 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d3f5685c-45af-4326-ac74-0d98b2c630ce tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:10.012160 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d3f5685c-45af-4326-ac74-0d98b2c630ce tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:10.012160 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d3f5685c-45af-4326-ac74-0d98b2c630ce tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:10.012160 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d3f5685c-45af-4326-ac74-0d98b2c630ce tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:10.012599 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d3f5685c-45af-4326-ac74-0d98b2c630ce tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:10.029071 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.quota [None req-d3f5685c-45af-4326-ac74-0d98b2c630ce tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Getting quotas for project 098c57b11d7948c8a1ef732af98ec75f. Resources: {'cores', 'ram', 'instances'} {{(pid=124726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 19:02:10.033091 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.quota [None req-d3f5685c-45af-4326-ac74-0d98b2c630ce tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Getting quotas for user dbed10f27ab548809755b32d0456d1bc and project 098c57b11d7948c8a1ef732af98ec75f. Resources: {'cores', 'ram', 'instances'} {{(pid=124726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 19:02:10.100510 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-d3f5685c-45af-4326-ac74-0d98b2c630ce tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Going to run 1 instances... {{(pid=124726) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 19:02:10.102944 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-d3f5685c-45af-4326-ac74-0d98b2c630ce tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 4e0810d4-4897-458d-bf93-4826c5770a5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8f747087-b7c4-4316-8a69-e7b1c71e3ec2',volume_size=None,volume_type=None)] {{(pid=124726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 19:02:10.490680 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-d3f5685c-45af-4326-ac74-0d98b2c630ce tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.025339 Aug 09 19:02:10.491706 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 541/1114] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 9 19:02:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 1027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 19:02:10.502108 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-3f2997d1-dee7-4ec6-ac69-58abfe26fa77 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:02:10.503387 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-3f2997d1-dee7-4ec6-ac69-58abfe26fa77 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 4e0810d4-4897-458d-bf93-4826c5770a5f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:02:10.558042 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-3f2997d1-dee7-4ec6-ac69-58abfe26fa77 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:02:10.564559 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-3f2997d1-dee7-4ec6-ac69-58abfe26fa77 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f" status: 200 len: 1094 microversion: 2.1 time: 0.066239 Aug 09 19:02:10.566023 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 574/1115] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:02:10 2022] GET /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:02:11.587133 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-7e78c2a5-4979-45b0-bf8f-56c8931d166a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:02:11.587712 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-7e78c2a5-4979-45b0-bf8f-56c8931d166a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 4e0810d4-4897-458d-bf93-4826c5770a5f] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:02:11.593881 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7e78c2a5-4979-45b0-bf8f-56c8931d166a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:11.594365 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7e78c2a5-4979-45b0-bf8f-56c8931d166a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:11.594802 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7e78c2a5-4979-45b0-bf8f-56c8931d166a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:11.595495 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7e78c2a5-4979-45b0-bf8f-56c8931d166a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:11.595996 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7e78c2a5-4979-45b0-bf8f-56c8931d166a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:11.596406 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7e78c2a5-4979-45b0-bf8f-56c8931d166a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:11.659648 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-7e78c2a5-4979-45b0-bf8f-56c8931d166a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:02:11.667139 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-7e78c2a5-4979-45b0-bf8f-56c8931d166a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f" status: 200 len: 1144 microversion: 2.1 time: 0.085091 Aug 09 19:02:11.677336 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 542/1116] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:02:11 2022] GET /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:02:12.119313 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 19:02:12.119908 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Tue Aug 9 19:02:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 19:02:12.687962 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-fc09c63c-15c2-4b87-9916-31e9edfb42a1 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:02:12.688570 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-fc09c63c-15c2-4b87-9916-31e9edfb42a1 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 4e0810d4-4897-458d-bf93-4826c5770a5f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:02:12.696010 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fc09c63c-15c2-4b87-9916-31e9edfb42a1 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:12.696483 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fc09c63c-15c2-4b87-9916-31e9edfb42a1 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:12.696912 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fc09c63c-15c2-4b87-9916-31e9edfb42a1 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:12.697619 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fc09c63c-15c2-4b87-9916-31e9edfb42a1 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:12.699374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fc09c63c-15c2-4b87-9916-31e9edfb42a1 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:12.699374 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fc09c63c-15c2-4b87-9916-31e9edfb42a1 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:12.762678 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-fc09c63c-15c2-4b87-9916-31e9edfb42a1 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:02:12.779776 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-fc09c63c-15c2-4b87-9916-31e9edfb42a1 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f" status: 200 len: 1200 microversion: 2.1 time: 0.094354 Aug 09 19:02:12.789713 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 575/1117] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:02:12 2022] GET /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f => generated 1200 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:02:13.800941 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-97911cf0-a7c1-4cbc-9fdc-828533b050cb tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:02:13.801581 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-97911cf0-a7c1-4cbc-9fdc-828533b050cb tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 4e0810d4-4897-458d-bf93-4826c5770a5f] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:02:13.808274 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-97911cf0-a7c1-4cbc-9fdc-828533b050cb tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:13.812063 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-97911cf0-a7c1-4cbc-9fdc-828533b050cb tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:13.812063 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-97911cf0-a7c1-4cbc-9fdc-828533b050cb tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:13.812063 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-97911cf0-a7c1-4cbc-9fdc-828533b050cb tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:13.812063 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-97911cf0-a7c1-4cbc-9fdc-828533b050cb tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:13.812459 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-97911cf0-a7c1-4cbc-9fdc-828533b050cb tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:14.041097 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-97911cf0-a7c1-4cbc-9fdc-828533b050cb tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:02:14.050188 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-97911cf0-a7c1-4cbc-9fdc-828533b050cb tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f" status: 200 len: 1278 microversion: 2.1 time: 0.253371 Aug 09 19:02:14.050907 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 543/1118] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:02:13 2022] GET /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f => generated 1278 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:02:14.252470 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-2f12dd77-d627-428c-a3aa-ab3c7407abed req-43ef7265-d9d3-46e5-bcba-f43ca2dade25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e0810d4-4897-458d-bf93-4826c5770a5f", "tag": "c694a3a7-c51a-45fd-b548-13ae2dede97e"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:02:14.265423 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-2f12dd77-d627-428c-a3aa-ab3c7407abed req-43ef7265-d9d3-46e5-bcba-f43ca2dade25 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:14.265423 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-2f12dd77-d627-428c-a3aa-ab3c7407abed req-43ef7265-d9d3-46e5-bcba-f43ca2dade25 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:14.265423 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-2f12dd77-d627-428c-a3aa-ab3c7407abed req-43ef7265-d9d3-46e5-bcba-f43ca2dade25 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:14.276914 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-2f12dd77-d627-428c-a3aa-ab3c7407abed req-43ef7265-d9d3-46e5-bcba-f43ca2dade25 service nova] Creating event network-changed:c694a3a7-c51a-45fd-b548-13ae2dede97e for instance 4e0810d4-4897-458d-bf93-4826c5770a5f on hv-cinder-82660 Aug 09 19:02:14.281718 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-2f12dd77-d627-428c-a3aa-ab3c7407abed req-43ef7265-d9d3-46e5-bcba-f43ca2dade25 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032960 Aug 09 19:02:14.282701 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 576/1119] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 19:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 19:02:15.072752 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-c8c03da3-853f-4944-b970-7b2f228e4f23 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:02:15.073405 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-c8c03da3-853f-4944-b970-7b2f228e4f23 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 4e0810d4-4897-458d-bf93-4826c5770a5f] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:02:15.080781 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c8c03da3-853f-4944-b970-7b2f228e4f23 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:15.081263 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c8c03da3-853f-4944-b970-7b2f228e4f23 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:15.081727 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c8c03da3-853f-4944-b970-7b2f228e4f23 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:15.082423 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c8c03da3-853f-4944-b970-7b2f228e4f23 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:15.082874 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c8c03da3-853f-4944-b970-7b2f228e4f23 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:15.083304 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-c8c03da3-853f-4944-b970-7b2f228e4f23 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:15.296291 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-c8c03da3-853f-4944-b970-7b2f228e4f23 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:02:15.303872 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-c8c03da3-853f-4944-b970-7b2f228e4f23 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f" status: 200 len: 1266 microversion: 2.1 time: 0.235631 Aug 09 19:02:15.304444 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 544/1120] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:02:15 2022] GET /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:02:16.325508 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-00d43b52-5ec9-41bd-8b82-c34fed15d724 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:02:16.326251 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-00d43b52-5ec9-41bd-8b82-c34fed15d724 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 4e0810d4-4897-458d-bf93-4826c5770a5f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:02:16.332402 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-00d43b52-5ec9-41bd-8b82-c34fed15d724 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:16.332884 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-00d43b52-5ec9-41bd-8b82-c34fed15d724 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:16.333320 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-00d43b52-5ec9-41bd-8b82-c34fed15d724 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:16.334057 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-00d43b52-5ec9-41bd-8b82-c34fed15d724 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:16.335030 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-00d43b52-5ec9-41bd-8b82-c34fed15d724 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:16.335456 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-00d43b52-5ec9-41bd-8b82-c34fed15d724 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:16.464621 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-00d43b52-5ec9-41bd-8b82-c34fed15d724 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:02:16.472642 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-00d43b52-5ec9-41bd-8b82-c34fed15d724 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f" status: 200 len: 1266 microversion: 2.1 time: 0.151929 Aug 09 19:02:16.473225 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 577/1121] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:02:16 2022] GET /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:02:17.494215 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-ec7e3ce1-caaa-4833-926a-d0b79a001c76 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:02:17.494815 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-ec7e3ce1-caaa-4833-926a-d0b79a001c76 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 4e0810d4-4897-458d-bf93-4826c5770a5f] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:02:17.501406 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ec7e3ce1-caaa-4833-926a-d0b79a001c76 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:17.502061 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ec7e3ce1-caaa-4833-926a-d0b79a001c76 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:17.502505 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ec7e3ce1-caaa-4833-926a-d0b79a001c76 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:17.503201 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ec7e3ce1-caaa-4833-926a-d0b79a001c76 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:17.503676 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ec7e3ce1-caaa-4833-926a-d0b79a001c76 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:17.504099 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-ec7e3ce1-caaa-4833-926a-d0b79a001c76 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:17.636225 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-ec7e3ce1-caaa-4833-926a-d0b79a001c76 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:02:17.643645 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-ec7e3ce1-caaa-4833-926a-d0b79a001c76 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f" status: 200 len: 1266 microversion: 2.1 time: 0.153958 Aug 09 19:02:17.644207 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 545/1122] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:02:17 2022] GET /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:02:18.664354 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-628a0c3f-934c-43e1-a9fa-9d6ae8b874b9 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:02:18.664969 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-628a0c3f-934c-43e1-a9fa-9d6ae8b874b9 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 4e0810d4-4897-458d-bf93-4826c5770a5f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:02:18.671459 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-628a0c3f-934c-43e1-a9fa-9d6ae8b874b9 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:18.671948 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-628a0c3f-934c-43e1-a9fa-9d6ae8b874b9 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:18.672385 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-628a0c3f-934c-43e1-a9fa-9d6ae8b874b9 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:18.673074 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-628a0c3f-934c-43e1-a9fa-9d6ae8b874b9 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:18.673547 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-628a0c3f-934c-43e1-a9fa-9d6ae8b874b9 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:18.673978 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-628a0c3f-934c-43e1-a9fa-9d6ae8b874b9 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:18.806507 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-628a0c3f-934c-43e1-a9fa-9d6ae8b874b9 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:02:18.814094 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-628a0c3f-934c-43e1-a9fa-9d6ae8b874b9 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f" status: 200 len: 1266 microversion: 2.1 time: 0.153626 Aug 09 19:02:18.814664 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 578/1123] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:02:18 2022] GET /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:02:19.839612 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-83ff57ad-02fd-44e7-9b2d-585f7ff32bc8 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:02:19.840152 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-83ff57ad-02fd-44e7-9b2d-585f7ff32bc8 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 4e0810d4-4897-458d-bf93-4826c5770a5f] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:02:19.846565 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-83ff57ad-02fd-44e7-9b2d-585f7ff32bc8 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:19.847044 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-83ff57ad-02fd-44e7-9b2d-585f7ff32bc8 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:19.847476 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-83ff57ad-02fd-44e7-9b2d-585f7ff32bc8 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:19.848165 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-83ff57ad-02fd-44e7-9b2d-585f7ff32bc8 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:19.848616 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-83ff57ad-02fd-44e7-9b2d-585f7ff32bc8 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:19.849040 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-83ff57ad-02fd-44e7-9b2d-585f7ff32bc8 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:19.983761 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-83ff57ad-02fd-44e7-9b2d-585f7ff32bc8 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:02:19.991235 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-83ff57ad-02fd-44e7-9b2d-585f7ff32bc8 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f" status: 200 len: 1266 microversion: 2.1 time: 0.155556 Aug 09 19:02:19.991801 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 546/1124] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:02:19 2022] GET /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:02:21.011469 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-9dbf2e1b-77db-4084-a25c-e3b9e73e9579 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:02:21.012071 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-9dbf2e1b-77db-4084-a25c-e3b9e73e9579 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 4e0810d4-4897-458d-bf93-4826c5770a5f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:02:21.014505 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=2 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:02:21.019288 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9dbf2e1b-77db-4084-a25c-e3b9e73e9579 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:21.019753 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9dbf2e1b-77db-4084-a25c-e3b9e73e9579 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:21.020182 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9dbf2e1b-77db-4084-a25c-e3b9e73e9579 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:21.020857 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9dbf2e1b-77db-4084-a25c-e3b9e73e9579 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:21.021301 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9dbf2e1b-77db-4084-a25c-e3b9e73e9579 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:21.021744 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9dbf2e1b-77db-4084-a25c-e3b9e73e9579 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:21.161414 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-9dbf2e1b-77db-4084-a25c-e3b9e73e9579 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:02:21.169392 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-9dbf2e1b-77db-4084-a25c-e3b9e73e9579 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f" status: 200 len: 1266 microversion: 2.1 time: 0.161740 Aug 09 19:02:21.169997 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 579/1125] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:02:21 2022] GET /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:02:22.190600 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-7aa6d80e-9d5a-4c50-8dd1-20ac4a0dc223 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:02:22.191250 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-7aa6d80e-9d5a-4c50-8dd1-20ac4a0dc223 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 4e0810d4-4897-458d-bf93-4826c5770a5f] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:02:22.193479 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell0:SELECT=2 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:02:22.194189 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell0:SELECT=6 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:02:22.200623 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7aa6d80e-9d5a-4c50-8dd1-20ac4a0dc223 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:22.207199 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7aa6d80e-9d5a-4c50-8dd1-20ac4a0dc223 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:22.207199 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7aa6d80e-9d5a-4c50-8dd1-20ac4a0dc223 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:22.207199 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7aa6d80e-9d5a-4c50-8dd1-20ac4a0dc223 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:22.207199 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7aa6d80e-9d5a-4c50-8dd1-20ac4a0dc223 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:22.207619 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-7aa6d80e-9d5a-4c50-8dd1-20ac4a0dc223 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:22.332523 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-7aa6d80e-9d5a-4c50-8dd1-20ac4a0dc223 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:02:22.340052 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-7aa6d80e-9d5a-4c50-8dd1-20ac4a0dc223 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f" status: 200 len: 1266 microversion: 2.1 time: 0.153611 Aug 09 19:02:22.340620 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 547/1126] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:02:22 2022] GET /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:02:23.360458 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5fdc2e80-5f75-481c-ad10-ab3c4e6aaeac tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:02:23.361056 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-5fdc2e80-5f75-481c-ad10-ab3c4e6aaeac tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 4e0810d4-4897-458d-bf93-4826c5770a5f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:02:23.367467 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5fdc2e80-5f75-481c-ad10-ab3c4e6aaeac tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:23.367945 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5fdc2e80-5f75-481c-ad10-ab3c4e6aaeac tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:23.368373 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5fdc2e80-5f75-481c-ad10-ab3c4e6aaeac tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:23.369044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5fdc2e80-5f75-481c-ad10-ab3c4e6aaeac tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:23.369486 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5fdc2e80-5f75-481c-ad10-ab3c4e6aaeac tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:23.369932 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5fdc2e80-5f75-481c-ad10-ab3c4e6aaeac tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:23.500678 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5fdc2e80-5f75-481c-ad10-ab3c4e6aaeac tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:02:23.509183 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-5fdc2e80-5f75-481c-ad10-ab3c4e6aaeac tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f" status: 200 len: 1266 microversion: 2.1 time: 0.152363 Aug 09 19:02:23.509796 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 580/1127] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:02:23 2022] GET /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:02:23.938492 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 19:02:23.938725 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Tue Aug 9 19:02:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 19:02:24.530878 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-d357646a-c038-413a-b986-f6689e67d9ae tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:02:24.535345 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-d357646a-c038-413a-b986-f6689e67d9ae tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 4e0810d4-4897-458d-bf93-4826c5770a5f] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:02:24.542758 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d357646a-c038-413a-b986-f6689e67d9ae tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:24.543169 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d357646a-c038-413a-b986-f6689e67d9ae tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:24.543604 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d357646a-c038-413a-b986-f6689e67d9ae tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:24.544300 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d357646a-c038-413a-b986-f6689e67d9ae tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:24.544755 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d357646a-c038-413a-b986-f6689e67d9ae tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:24.545181 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-d357646a-c038-413a-b986-f6689e67d9ae tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:24.677930 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-d357646a-c038-413a-b986-f6689e67d9ae tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:02:24.686195 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-d357646a-c038-413a-b986-f6689e67d9ae tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f" status: 200 len: 1266 microversion: 2.1 time: 0.159561 Aug 09 19:02:24.686787 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 548/1128] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:02:24 2022] GET /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:02:25.707648 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-6187c12d-d121-4875-91f3-d3cd10e98070 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:02:25.708251 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-6187c12d-d121-4875-91f3-d3cd10e98070 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 4e0810d4-4897-458d-bf93-4826c5770a5f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:02:25.714683 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6187c12d-d121-4875-91f3-d3cd10e98070 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:25.715163 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6187c12d-d121-4875-91f3-d3cd10e98070 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:25.715590 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6187c12d-d121-4875-91f3-d3cd10e98070 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:25.716272 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6187c12d-d121-4875-91f3-d3cd10e98070 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:25.716715 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6187c12d-d121-4875-91f3-d3cd10e98070 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:25.717133 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6187c12d-d121-4875-91f3-d3cd10e98070 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:25.849655 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-6187c12d-d121-4875-91f3-d3cd10e98070 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:02:25.857707 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-6187c12d-d121-4875-91f3-d3cd10e98070 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f" status: 200 len: 1266 microversion: 2.1 time: 0.153906 Aug 09 19:02:25.858272 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 581/1129] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:02:25 2022] GET /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:02:26.488611 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-02fc2264-ac68-4b5d-a7c4-1483a05f1684 req-a4bd2fb0-4838-4b24-877a-a8ca8786a730 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e0810d4-4897-458d-bf93-4826c5770a5f", "name": "network-vif-plugged", "status": "completed", "tag": "c694a3a7-c51a-45fd-b548-13ae2dede97e"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:02:26.498659 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-02fc2264-ac68-4b5d-a7c4-1483a05f1684 req-a4bd2fb0-4838-4b24-877a-a8ca8786a730 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:26.499092 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-02fc2264-ac68-4b5d-a7c4-1483a05f1684 req-a4bd2fb0-4838-4b24-877a-a8ca8786a730 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:26.499502 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-02fc2264-ac68-4b5d-a7c4-1483a05f1684 req-a4bd2fb0-4838-4b24-877a-a8ca8786a730 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:26.511210 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-02fc2264-ac68-4b5d-a7c4-1483a05f1684 req-a4bd2fb0-4838-4b24-877a-a8ca8786a730 service nova] Creating event network-vif-plugged:c694a3a7-c51a-45fd-b548-13ae2dede97e for instance 4e0810d4-4897-458d-bf93-4826c5770a5f on hv-cinder-82660 Aug 09 19:02:26.514715 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR oslo.messaging._drivers.impl_rabbit [req-02fc2264-ac68-4b5d-a7c4-1483a05f1684 req-a4bd2fb0-4838-4b24-877a-a8ca8786a730 service nova] [fde42d90-183b-4a99-8916-720cc70bb2d9] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 09 19:02:26.878472 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-9659fd10-7639-4edc-b7c3-34acaa6f2ed4 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:02:26.879081 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-9659fd10-7639-4edc-b7c3-34acaa6f2ed4 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 4e0810d4-4897-458d-bf93-4826c5770a5f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:02:26.886148 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9659fd10-7639-4edc-b7c3-34acaa6f2ed4 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:26.886617 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9659fd10-7639-4edc-b7c3-34acaa6f2ed4 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:26.887044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9659fd10-7639-4edc-b7c3-34acaa6f2ed4 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:26.887721 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9659fd10-7639-4edc-b7c3-34acaa6f2ed4 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:26.888167 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9659fd10-7639-4edc-b7c3-34acaa6f2ed4 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:26.888586 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9659fd10-7639-4edc-b7c3-34acaa6f2ed4 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:27.023858 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-9659fd10-7639-4edc-b7c3-34acaa6f2ed4 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:02:27.031285 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-9659fd10-7639-4edc-b7c3-34acaa6f2ed4 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f" status: 200 len: 1266 microversion: 2.1 time: 0.156663 Aug 09 19:02:27.031843 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 582/1130] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:02:26 2022] GET /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:02:27.521562 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO oslo.messaging._drivers.impl_rabbit [req-02fc2264-ac68-4b5d-a7c4-1483a05f1684 req-a4bd2fb0-4838-4b24-877a-a8ca8786a730 service nova] [fde42d90-183b-4a99-8916-720cc70bb2d9] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 54800. Aug 09 19:02:27.525391 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-02fc2264-ac68-4b5d-a7c4-1483a05f1684 req-a4bd2fb0-4838-4b24-877a-a8ca8786a730 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.040690 Aug 09 19:02:27.530991 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 549/1131] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 19:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:02:28.051593 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-4177f8d3-1f5e-4854-b6a7-6f9eec9245fc tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:02:28.052231 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-4177f8d3-1f5e-4854-b6a7-6f9eec9245fc tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 4e0810d4-4897-458d-bf93-4826c5770a5f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:02:28.058456 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4177f8d3-1f5e-4854-b6a7-6f9eec9245fc tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:28.058972 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4177f8d3-1f5e-4854-b6a7-6f9eec9245fc tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:28.059402 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4177f8d3-1f5e-4854-b6a7-6f9eec9245fc tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:28.060081 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4177f8d3-1f5e-4854-b6a7-6f9eec9245fc tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:28.060527 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4177f8d3-1f5e-4854-b6a7-6f9eec9245fc tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:28.060943 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4177f8d3-1f5e-4854-b6a7-6f9eec9245fc tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:28.192289 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-4177f8d3-1f5e-4854-b6a7-6f9eec9245fc tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:02:28.200631 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-4177f8d3-1f5e-4854-b6a7-6f9eec9245fc tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f" status: 200 len: 1266 microversion: 2.1 time: 0.152991 Aug 09 19:02:28.201203 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 583/1132] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:02:28 2022] GET /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:02:29.221278 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-6370b23a-a2ed-4b12-86d4-b758763459c1 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:02:29.221989 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-6370b23a-a2ed-4b12-86d4-b758763459c1 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 4e0810d4-4897-458d-bf93-4826c5770a5f] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:02:29.228585 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6370b23a-a2ed-4b12-86d4-b758763459c1 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:29.231887 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6370b23a-a2ed-4b12-86d4-b758763459c1 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:29.231887 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6370b23a-a2ed-4b12-86d4-b758763459c1 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:29.231887 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6370b23a-a2ed-4b12-86d4-b758763459c1 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:29.231887 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6370b23a-a2ed-4b12-86d4-b758763459c1 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:29.232311 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-6370b23a-a2ed-4b12-86d4-b758763459c1 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:29.362428 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-6370b23a-a2ed-4b12-86d4-b758763459c1 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:02:29.370664 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-6370b23a-a2ed-4b12-86d4-b758763459c1 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f" status: 200 len: 1451 microversion: 2.1 time: 0.154047 Aug 09 19:02:29.371284 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 550/1133] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:02:29 2022] GET /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:02:29.390224 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-fdcf2c41-81e3-4dfd-b0d2-80312d03571d tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:02:29.390871 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-fdcf2c41-81e3-4dfd-b0d2-80312d03571d tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 4e0810d4-4897-458d-bf93-4826c5770a5f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:02:29.397204 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fdcf2c41-81e3-4dfd-b0d2-80312d03571d tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:29.397761 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fdcf2c41-81e3-4dfd-b0d2-80312d03571d tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:29.398201 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fdcf2c41-81e3-4dfd-b0d2-80312d03571d tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:29.399192 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fdcf2c41-81e3-4dfd-b0d2-80312d03571d tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:29.399846 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fdcf2c41-81e3-4dfd-b0d2-80312d03571d tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:29.400276 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fdcf2c41-81e3-4dfd-b0d2-80312d03571d tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:29.531428 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-fdcf2c41-81e3-4dfd-b0d2-80312d03571d tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:02:29.539669 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-fdcf2c41-81e3-4dfd-b0d2-80312d03571d tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f" status: 200 len: 1451 microversion: 2.1 time: 0.153387 Aug 09 19:02:29.540231 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 584/1134] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:02:29 2022] GET /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:02:31.523141 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-5c857a13-9a41-4dde-bcba-3900f0c41a12 req-662afaf0-b12a-4873-add1-f03aea3655ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e0810d4-4897-458d-bf93-4826c5770a5f", "tag": "c694a3a7-c51a-45fd-b548-13ae2dede97e"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:02:31.532461 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-5c857a13-9a41-4dde-bcba-3900f0c41a12 req-662afaf0-b12a-4873-add1-f03aea3655ee service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:02:31.532954 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-5c857a13-9a41-4dde-bcba-3900f0c41a12 req-662afaf0-b12a-4873-add1-f03aea3655ee service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:02:31.533352 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-5c857a13-9a41-4dde-bcba-3900f0c41a12 req-662afaf0-b12a-4873-add1-f03aea3655ee service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:02:31.547497 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-5c857a13-9a41-4dde-bcba-3900f0c41a12 req-662afaf0-b12a-4873-add1-f03aea3655ee service nova] Creating event network-changed:c694a3a7-c51a-45fd-b548-13ae2dede97e for instance 4e0810d4-4897-458d-bf93-4826c5770a5f on hv-cinder-82660 Aug 09 19:02:31.552666 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-5c857a13-9a41-4dde-bcba-3900f0c41a12 req-662afaf0-b12a-4873-add1-f03aea3655ee service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093440 Aug 09 19:02:31.553448 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 551/1135] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 19:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:04:08.363299 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:04:08.364064 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:04:08.367981 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-34282442-ae0d-4c88-bcc1-c4b89dc61bac tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-448294670", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-155422797", "security_groups": [{"name": "tempest-secgroup-smoke-2002964655"}], "block_device_mapping_v2": [{"uuid": "59f8bc15-f1a5-444d-a6d3-bf0beabd1008", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "20437699-6aec-4ae5-8d1b-64fe31f9d07b"}]}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:04:08.580247 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.network.neutron [None req-34282442-ae0d-4c88-bcc1-c4b89dc61bac tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] validate_networks() for [('20437699-6aec-4ae5-8d1b-64fe31f9d07b', None, None, None, None, None)] {{(pid=124725) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 19:04:08.993547 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-34282442-ae0d-4c88-bcc1-c4b89dc61bac tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Flavor limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 19:04:08.993984 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-34282442-ae0d-4c88-bcc1-c4b89dc61bac tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Image limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 19:04:08.994457 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-34282442-ae0d-4c88-bcc1-c4b89dc61bac tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Flavor pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 19:04:08.994864 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-34282442-ae0d-4c88-bcc1-c4b89dc61bac tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Image pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 19:04:08.995268 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-34282442-ae0d-4c88-bcc1-c4b89dc61bac tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 19:04:09.004669 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-34282442-ae0d-4c88-bcc1-c4b89dc61bac tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:04:09.005141 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-34282442-ae0d-4c88-bcc1-c4b89dc61bac tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:04:09.005615 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-34282442-ae0d-4c88-bcc1-c4b89dc61bac tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:04:09.006326 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-34282442-ae0d-4c88-bcc1-c4b89dc61bac tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:04:09.006768 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-34282442-ae0d-4c88-bcc1-c4b89dc61bac tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:04:09.007181 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-34282442-ae0d-4c88-bcc1-c4b89dc61bac tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:04:09.026964 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-34282442-ae0d-4c88-bcc1-c4b89dc61bac tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Getting quotas for project 098c57b11d7948c8a1ef732af98ec75f. Resources: {'cores', 'ram', 'instances'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 19:04:09.034325 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-34282442-ae0d-4c88-bcc1-c4b89dc61bac tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Getting quotas for user dbed10f27ab548809755b32d0456d1bc and project 098c57b11d7948c8a1ef732af98ec75f. Resources: {'cores', 'ram', 'instances'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 19:04:09.092578 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-34282442-ae0d-4c88-bcc1-c4b89dc61bac tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Going to run 1 instances... {{(pid=124725) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 19:04:09.094725 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-34282442-ae0d-4c88-bcc1-c4b89dc61bac tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 8c44931e-02cc-406a-b6ad-b13ff297ff55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='59f8bc15-f1a5-444d-a6d3-bf0beabd1008',volume_size=None,volume_type=None)] {{(pid=124725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 19:04:09.425975 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-34282442-ae0d-4c88-bcc1-c4b89dc61bac tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.064373 Aug 09 19:04:09.427350 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 585/1136] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 9 19:04:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 1066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 19:04:09.435868 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:04:09.436681 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell1:SELECT=74 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:04:09.441410 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-594b66c1-13b3-490c-86a3-204220971b1a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:04:09.442146 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-594b66c1-13b3-490c-86a3-204220971b1a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 8c44931e-02cc-406a-b6ad-b13ff297ff55] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:04:09.551282 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-594b66c1-13b3-490c-86a3-204220971b1a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:04:09.557926 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-594b66c1-13b3-490c-86a3-204220971b1a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/8c44931e-02cc-406a-b6ad-b13ff297ff55" status: 200 len: 1093 microversion: 2.1 time: 0.124143 Aug 09 19:04:09.558482 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 552/1137] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:04:09 2022] GET /compute/v2.1/servers/8c44931e-02cc-406a-b6ad-b13ff297ff55 => generated 1093 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:04:10.579266 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-71e09259-d35a-4bb4-a67d-e9ea06550760 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:04:10.579883 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-71e09259-d35a-4bb4-a67d-e9ea06550760 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 8c44931e-02cc-406a-b6ad-b13ff297ff55] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:04:10.586665 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-71e09259-d35a-4bb4-a67d-e9ea06550760 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:04:10.587150 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-71e09259-d35a-4bb4-a67d-e9ea06550760 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:04:10.587587 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-71e09259-d35a-4bb4-a67d-e9ea06550760 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:04:10.588284 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-71e09259-d35a-4bb4-a67d-e9ea06550760 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:04:10.588768 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-71e09259-d35a-4bb4-a67d-e9ea06550760 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:04:10.589198 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-71e09259-d35a-4bb4-a67d-e9ea06550760 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:04:10.654164 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-71e09259-d35a-4bb4-a67d-e9ea06550760 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:04:10.662439 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-71e09259-d35a-4bb4-a67d-e9ea06550760 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/8c44931e-02cc-406a-b6ad-b13ff297ff55" status: 200 len: 1135 microversion: 2.1 time: 0.087540 Aug 09 19:04:10.663012 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 586/1138] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:04:10 2022] GET /compute/v2.1/servers/8c44931e-02cc-406a-b6ad-b13ff297ff55 => generated 1135 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:04:11.690738 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-e6a3fe4d-27c7-4d22-85d8-0da3e04cac73 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:04:11.691366 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-e6a3fe4d-27c7-4d22-85d8-0da3e04cac73 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 8c44931e-02cc-406a-b6ad-b13ff297ff55] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:04:11.699141 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e6a3fe4d-27c7-4d22-85d8-0da3e04cac73 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:04:11.701163 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e6a3fe4d-27c7-4d22-85d8-0da3e04cac73 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:04:11.701163 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e6a3fe4d-27c7-4d22-85d8-0da3e04cac73 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:04:11.701163 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e6a3fe4d-27c7-4d22-85d8-0da3e04cac73 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:04:11.701163 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e6a3fe4d-27c7-4d22-85d8-0da3e04cac73 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:04:11.701604 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-e6a3fe4d-27c7-4d22-85d8-0da3e04cac73 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:04:11.782885 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-e6a3fe4d-27c7-4d22-85d8-0da3e04cac73 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:04:11.790433 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-e6a3fe4d-27c7-4d22-85d8-0da3e04cac73 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/8c44931e-02cc-406a-b6ad-b13ff297ff55" status: 200 len: 1209 microversion: 2.1 time: 0.104239 Aug 09 19:04:11.791314 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 553/1139] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:04:11 2022] GET /compute/v2.1/servers/8c44931e-02cc-406a-b6ad-b13ff297ff55 => generated 1209 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:04:12.813356 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-954ad729-7803-432d-a5a3-67f1f2995f97 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:04:12.814108 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-954ad729-7803-432d-a5a3-67f1f2995f97 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 8c44931e-02cc-406a-b6ad-b13ff297ff55] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:04:12.820907 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-954ad729-7803-432d-a5a3-67f1f2995f97 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:04:12.821469 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-954ad729-7803-432d-a5a3-67f1f2995f97 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:04:12.821935 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-954ad729-7803-432d-a5a3-67f1f2995f97 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:04:12.822594 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-954ad729-7803-432d-a5a3-67f1f2995f97 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:04:12.823037 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-954ad729-7803-432d-a5a3-67f1f2995f97 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:04:12.823502 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-954ad729-7803-432d-a5a3-67f1f2995f97 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:04:12.931304 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-643da7ee-5bf5-4778-a616-d88d4caac24f req-4d30bdfe-1794-427b-b5fa-b25b3136f3af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c44931e-02cc-406a-b6ad-b13ff297ff55", "tag": "4f7bb470-1f68-40d8-8609-811d1c967a4e"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:04:12.943332 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-643da7ee-5bf5-4778-a616-d88d4caac24f req-4d30bdfe-1794-427b-b5fa-b25b3136f3af service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:04:12.944120 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-643da7ee-5bf5-4778-a616-d88d4caac24f req-4d30bdfe-1794-427b-b5fa-b25b3136f3af service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:04:12.944563 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-643da7ee-5bf5-4778-a616-d88d4caac24f req-4d30bdfe-1794-427b-b5fa-b25b3136f3af service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:04:12.956181 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-643da7ee-5bf5-4778-a616-d88d4caac24f req-4d30bdfe-1794-427b-b5fa-b25b3136f3af service nova] Creating event network-changed:4f7bb470-1f68-40d8-8609-811d1c967a4e for instance 8c44931e-02cc-406a-b6ad-b13ff297ff55 on hv-cinder-82660 Aug 09 19:04:12.961546 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-643da7ee-5bf5-4778-a616-d88d4caac24f req-4d30bdfe-1794-427b-b5fa-b25b3136f3af service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034518 Aug 09 19:04:12.962743 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 554/1140] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 19:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:04:12.968439 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-954ad729-7803-432d-a5a3-67f1f2995f97 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:04:12.976345 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-954ad729-7803-432d-a5a3-67f1f2995f97 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/8c44931e-02cc-406a-b6ad-b13ff297ff55" status: 200 len: 1265 microversion: 2.1 time: 0.167544 Aug 09 19:04:12.976923 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 587/1141] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:04:12 2022] GET /compute/v2.1/servers/8c44931e-02cc-406a-b6ad-b13ff297ff55 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:04:13.998223 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-2b60eb7e-f454-4a6e-baf8-3ecd43acd002 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:04:13.998949 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-2b60eb7e-f454-4a6e-baf8-3ecd43acd002 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 8c44931e-02cc-406a-b6ad-b13ff297ff55] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:04:14.005077 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2b60eb7e-f454-4a6e-baf8-3ecd43acd002 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:04:14.005587 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2b60eb7e-f454-4a6e-baf8-3ecd43acd002 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:04:14.006024 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2b60eb7e-f454-4a6e-baf8-3ecd43acd002 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:04:14.006711 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2b60eb7e-f454-4a6e-baf8-3ecd43acd002 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:04:14.007163 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2b60eb7e-f454-4a6e-baf8-3ecd43acd002 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:04:14.007591 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2b60eb7e-f454-4a6e-baf8-3ecd43acd002 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:04:14.141862 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-2b60eb7e-f454-4a6e-baf8-3ecd43acd002 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:04:14.149382 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-2b60eb7e-f454-4a6e-baf8-3ecd43acd002 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/8c44931e-02cc-406a-b6ad-b13ff297ff55" status: 200 len: 1265 microversion: 2.1 time: 0.155837 Aug 09 19:04:14.150020 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 555/1142] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:04:13 2022] GET /compute/v2.1/servers/8c44931e-02cc-406a-b6ad-b13ff297ff55 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:04:15.170268 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d3dc4377-db42-4a1a-bae9-c0b81b887312 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:04:15.170868 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-d3dc4377-db42-4a1a-bae9-c0b81b887312 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 8c44931e-02cc-406a-b6ad-b13ff297ff55] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:04:15.177413 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d3dc4377-db42-4a1a-bae9-c0b81b887312 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:04:15.177926 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d3dc4377-db42-4a1a-bae9-c0b81b887312 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:04:15.178372 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d3dc4377-db42-4a1a-bae9-c0b81b887312 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:04:15.179077 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d3dc4377-db42-4a1a-bae9-c0b81b887312 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:04:15.179568 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d3dc4377-db42-4a1a-bae9-c0b81b887312 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:04:15.179994 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d3dc4377-db42-4a1a-bae9-c0b81b887312 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:04:15.311747 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d3dc4377-db42-4a1a-bae9-c0b81b887312 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:04:15.319414 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-d3dc4377-db42-4a1a-bae9-c0b81b887312 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/8c44931e-02cc-406a-b6ad-b13ff297ff55" status: 200 len: 1265 microversion: 2.1 time: 0.153176 Aug 09 19:04:15.319987 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 588/1143] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:04:15 2022] GET /compute/v2.1/servers/8c44931e-02cc-406a-b6ad-b13ff297ff55 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:04:16.340376 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-9319a758-c09d-406a-8b34-20ee22bfa3d2 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:04:16.340958 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-9319a758-c09d-406a-8b34-20ee22bfa3d2 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 8c44931e-02cc-406a-b6ad-b13ff297ff55] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:04:16.348003 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9319a758-c09d-406a-8b34-20ee22bfa3d2 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:04:16.348482 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9319a758-c09d-406a-8b34-20ee22bfa3d2 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:04:16.348919 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9319a758-c09d-406a-8b34-20ee22bfa3d2 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:04:16.349639 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9319a758-c09d-406a-8b34-20ee22bfa3d2 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:04:16.350103 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9319a758-c09d-406a-8b34-20ee22bfa3d2 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:04:16.350533 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-9319a758-c09d-406a-8b34-20ee22bfa3d2 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:04:16.488357 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-9319a758-c09d-406a-8b34-20ee22bfa3d2 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:04:16.495844 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-9319a758-c09d-406a-8b34-20ee22bfa3d2 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/8c44931e-02cc-406a-b6ad-b13ff297ff55" status: 200 len: 1265 microversion: 2.1 time: 0.159378 Aug 09 19:04:16.496407 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 556/1144] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:04:16 2022] GET /compute/v2.1/servers/8c44931e-02cc-406a-b6ad-b13ff297ff55 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:04:17.516835 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c6e28cd2-6420-4e8c-a771-cdcbae324151 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:04:17.527334 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-c6e28cd2-6420-4e8c-a771-cdcbae324151 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 8c44931e-02cc-406a-b6ad-b13ff297ff55] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:04:17.527334 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c6e28cd2-6420-4e8c-a771-cdcbae324151 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:04:17.527334 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c6e28cd2-6420-4e8c-a771-cdcbae324151 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:04:17.527334 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c6e28cd2-6420-4e8c-a771-cdcbae324151 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:04:17.527887 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c6e28cd2-6420-4e8c-a771-cdcbae324151 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:04:17.527887 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c6e28cd2-6420-4e8c-a771-cdcbae324151 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:04:17.527887 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c6e28cd2-6420-4e8c-a771-cdcbae324151 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:04:17.660684 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-c6e28cd2-6420-4e8c-a771-cdcbae324151 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:04:17.668114 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-c6e28cd2-6420-4e8c-a771-cdcbae324151 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/8c44931e-02cc-406a-b6ad-b13ff297ff55" status: 200 len: 1265 microversion: 2.1 time: 0.155843 Aug 09 19:04:17.668676 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 589/1145] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:04:17 2022] GET /compute/v2.1/servers/8c44931e-02cc-406a-b6ad-b13ff297ff55 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:04:18.688279 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-367a6ef6-74da-4d34-a796-f0503cdf8a3c tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:04:18.688894 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-367a6ef6-74da-4d34-a796-f0503cdf8a3c tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 8c44931e-02cc-406a-b6ad-b13ff297ff55] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:04:18.695582 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-367a6ef6-74da-4d34-a796-f0503cdf8a3c tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:04:18.696060 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-367a6ef6-74da-4d34-a796-f0503cdf8a3c tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:04:18.696492 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-367a6ef6-74da-4d34-a796-f0503cdf8a3c tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:04:18.697182 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-367a6ef6-74da-4d34-a796-f0503cdf8a3c tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:04:18.697670 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-367a6ef6-74da-4d34-a796-f0503cdf8a3c tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:04:18.698094 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-367a6ef6-74da-4d34-a796-f0503cdf8a3c tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:04:18.836718 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-367a6ef6-74da-4d34-a796-f0503cdf8a3c tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:04:18.838678 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-367a6ef6-74da-4d34-a796-f0503cdf8a3c tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/8c44931e-02cc-406a-b6ad-b13ff297ff55" status: 200 len: 1265 microversion: 2.1 time: 0.154301 Aug 09 19:04:18.839237 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 557/1146] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:04:18 2022] GET /compute/v2.1/servers/8c44931e-02cc-406a-b6ad-b13ff297ff55 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:04:19.859023 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-8a404710-c7ad-4c21-bdb2-52dab5a674aa tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:04:19.859630 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-8a404710-c7ad-4c21-bdb2-52dab5a674aa tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 8c44931e-02cc-406a-b6ad-b13ff297ff55] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:04:19.862320 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=2 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:04:19.862995 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=6 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:04:19.867929 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8a404710-c7ad-4c21-bdb2-52dab5a674aa tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:04:19.868415 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8a404710-c7ad-4c21-bdb2-52dab5a674aa tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:04:19.868853 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8a404710-c7ad-4c21-bdb2-52dab5a674aa tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:04:19.869577 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8a404710-c7ad-4c21-bdb2-52dab5a674aa tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:04:19.870112 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8a404710-c7ad-4c21-bdb2-52dab5a674aa tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:04:19.876123 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8a404710-c7ad-4c21-bdb2-52dab5a674aa tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:04:20.000778 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-8a404710-c7ad-4c21-bdb2-52dab5a674aa tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:04:20.008495 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-8a404710-c7ad-4c21-bdb2-52dab5a674aa tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/8c44931e-02cc-406a-b6ad-b13ff297ff55" status: 200 len: 1265 microversion: 2.1 time: 0.153330 Aug 09 19:04:20.009063 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 590/1147] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:04:19 2022] GET /compute/v2.1/servers/8c44931e-02cc-406a-b6ad-b13ff297ff55 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:04:21.029381 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-49d75ae0-61ce-49e4-bff1-68f0f9307936 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:04:21.030024 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-49d75ae0-61ce-49e4-bff1-68f0f9307936 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 8c44931e-02cc-406a-b6ad-b13ff297ff55] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:04:21.032549 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell0:SELECT=2 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:04:21.037843 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-49d75ae0-61ce-49e4-bff1-68f0f9307936 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:04:21.038335 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-49d75ae0-61ce-49e4-bff1-68f0f9307936 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:04:21.038773 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-49d75ae0-61ce-49e4-bff1-68f0f9307936 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:04:21.039480 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-49d75ae0-61ce-49e4-bff1-68f0f9307936 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:04:21.039936 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-49d75ae0-61ce-49e4-bff1-68f0f9307936 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:04:21.040370 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-49d75ae0-61ce-49e4-bff1-68f0f9307936 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:04:21.176365 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-49d75ae0-61ce-49e4-bff1-68f0f9307936 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:04:21.186410 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-49d75ae0-61ce-49e4-bff1-68f0f9307936 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/8c44931e-02cc-406a-b6ad-b13ff297ff55" status: 200 len: 1265 microversion: 2.1 time: 0.160871 Aug 09 19:04:21.186970 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 558/1148] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:04:21 2022] GET /compute/v2.1/servers/8c44931e-02cc-406a-b6ad-b13ff297ff55 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:04:22.207135 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-42f0879d-376d-4a6c-a7aa-4185debc4db3 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:04:22.207693 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-42f0879d-376d-4a6c-a7aa-4185debc4db3 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 8c44931e-02cc-406a-b6ad-b13ff297ff55] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:04:22.214109 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-42f0879d-376d-4a6c-a7aa-4185debc4db3 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:04:22.214584 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-42f0879d-376d-4a6c-a7aa-4185debc4db3 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:04:22.215007 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-42f0879d-376d-4a6c-a7aa-4185debc4db3 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:04:22.215686 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-42f0879d-376d-4a6c-a7aa-4185debc4db3 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:04:22.216129 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-42f0879d-376d-4a6c-a7aa-4185debc4db3 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:04:22.216539 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-42f0879d-376d-4a6c-a7aa-4185debc4db3 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:04:22.347994 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-42f0879d-376d-4a6c-a7aa-4185debc4db3 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:04:22.355634 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-42f0879d-376d-4a6c-a7aa-4185debc4db3 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/8c44931e-02cc-406a-b6ad-b13ff297ff55" status: 200 len: 1265 microversion: 2.1 time: 0.152435 Aug 09 19:04:22.356203 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 591/1149] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:04:22 2022] GET /compute/v2.1/servers/8c44931e-02cc-406a-b6ad-b13ff297ff55 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:04:23.376759 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-1aefea00-54df-4c77-a9a6-54deae03ac2d tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:04:23.377376 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-1aefea00-54df-4c77-a9a6-54deae03ac2d tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 8c44931e-02cc-406a-b6ad-b13ff297ff55] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:04:23.383891 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1aefea00-54df-4c77-a9a6-54deae03ac2d tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:04:23.384375 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1aefea00-54df-4c77-a9a6-54deae03ac2d tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:04:23.384810 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1aefea00-54df-4c77-a9a6-54deae03ac2d tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:04:23.385506 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1aefea00-54df-4c77-a9a6-54deae03ac2d tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:04:23.385987 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1aefea00-54df-4c77-a9a6-54deae03ac2d tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:04:23.386412 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-1aefea00-54df-4c77-a9a6-54deae03ac2d tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:04:23.528838 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-1aefea00-54df-4c77-a9a6-54deae03ac2d tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:04:23.536469 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-1aefea00-54df-4c77-a9a6-54deae03ac2d tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/8c44931e-02cc-406a-b6ad-b13ff297ff55" status: 200 len: 1265 microversion: 2.1 time: 0.163602 Aug 09 19:04:23.537076 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 559/1150] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:04:23 2022] GET /compute/v2.1/servers/8c44931e-02cc-406a-b6ad-b13ff297ff55 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:04:24.557731 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a322b01e-74ce-49fe-b67c-192ae4b8791a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:04:24.558356 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-a322b01e-74ce-49fe-b67c-192ae4b8791a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 8c44931e-02cc-406a-b6ad-b13ff297ff55] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:04:24.564741 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a322b01e-74ce-49fe-b67c-192ae4b8791a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:04:24.565222 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a322b01e-74ce-49fe-b67c-192ae4b8791a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:04:24.565690 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a322b01e-74ce-49fe-b67c-192ae4b8791a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:04:24.566384 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a322b01e-74ce-49fe-b67c-192ae4b8791a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:04:24.566834 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a322b01e-74ce-49fe-b67c-192ae4b8791a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:04:24.567257 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a322b01e-74ce-49fe-b67c-192ae4b8791a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:04:24.702977 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-a322b01e-74ce-49fe-b67c-192ae4b8791a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:04:24.709659 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-a322b01e-74ce-49fe-b67c-192ae4b8791a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/8c44931e-02cc-406a-b6ad-b13ff297ff55" status: 200 len: 1265 microversion: 2.1 time: 0.155809 Aug 09 19:04:24.710239 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 592/1151] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:04:24 2022] GET /compute/v2.1/servers/8c44931e-02cc-406a-b6ad-b13ff297ff55 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:04:25.226782 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-2115193a-bb09-48bd-993a-8ef77292478a req-f43ec2c4-b56e-48d0-bd4e-7a0112781ba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c44931e-02cc-406a-b6ad-b13ff297ff55", "name": "network-vif-plugged", "status": "completed", "tag": "4f7bb470-1f68-40d8-8609-811d1c967a4e"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:04:25.237770 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-2115193a-bb09-48bd-993a-8ef77292478a req-f43ec2c4-b56e-48d0-bd4e-7a0112781ba4 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:04:25.237770 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-2115193a-bb09-48bd-993a-8ef77292478a req-f43ec2c4-b56e-48d0-bd4e-7a0112781ba4 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:04:25.237770 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-2115193a-bb09-48bd-993a-8ef77292478a req-f43ec2c4-b56e-48d0-bd4e-7a0112781ba4 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:04:25.248492 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-2115193a-bb09-48bd-993a-8ef77292478a req-f43ec2c4-b56e-48d0-bd4e-7a0112781ba4 service nova] Creating event network-vif-plugged:4f7bb470-1f68-40d8-8609-811d1c967a4e for instance 8c44931e-02cc-406a-b6ad-b13ff297ff55 on hv-cinder-82660 Aug 09 19:04:25.253484 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-2115193a-bb09-48bd-993a-8ef77292478a req-f43ec2c4-b56e-48d0-bd4e-7a0112781ba4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030501 Aug 09 19:04:25.254138 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 560/1152] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 19:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:04:25.781884 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d56e9139-b839-474d-bb4c-acbc79fd0b99 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:04:25.782516 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-d56e9139-b839-474d-bb4c-acbc79fd0b99 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 8c44931e-02cc-406a-b6ad-b13ff297ff55] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:04:25.788336 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d56e9139-b839-474d-bb4c-acbc79fd0b99 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:04:25.788807 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d56e9139-b839-474d-bb4c-acbc79fd0b99 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:04:25.789234 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d56e9139-b839-474d-bb4c-acbc79fd0b99 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:04:25.789970 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d56e9139-b839-474d-bb4c-acbc79fd0b99 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:04:25.790394 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d56e9139-b839-474d-bb4c-acbc79fd0b99 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:04:25.790806 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d56e9139-b839-474d-bb4c-acbc79fd0b99 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:04:25.926118 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d56e9139-b839-474d-bb4c-acbc79fd0b99 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:04:25.928108 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-d56e9139-b839-474d-bb4c-acbc79fd0b99 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/8c44931e-02cc-406a-b6ad-b13ff297ff55" status: 200 len: 1265 microversion: 2.1 time: 0.201272 Aug 09 19:04:25.928675 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 593/1153] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:04:25 2022] GET /compute/v2.1/servers/8c44931e-02cc-406a-b6ad-b13ff297ff55 => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:04:26.948917 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-a55a170a-7bc1-4fda-9b7d-463e43dec82f tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:04:26.949661 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-a55a170a-7bc1-4fda-9b7d-463e43dec82f tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 8c44931e-02cc-406a-b6ad-b13ff297ff55] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:04:26.956948 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a55a170a-7bc1-4fda-9b7d-463e43dec82f tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:04:26.957444 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a55a170a-7bc1-4fda-9b7d-463e43dec82f tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:04:26.957916 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a55a170a-7bc1-4fda-9b7d-463e43dec82f tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:04:26.958597 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a55a170a-7bc1-4fda-9b7d-463e43dec82f tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:04:26.959047 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a55a170a-7bc1-4fda-9b7d-463e43dec82f tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:04:26.959463 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a55a170a-7bc1-4fda-9b7d-463e43dec82f tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:04:27.094449 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-a55a170a-7bc1-4fda-9b7d-463e43dec82f tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:04:27.101987 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-a55a170a-7bc1-4fda-9b7d-463e43dec82f tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/8c44931e-02cc-406a-b6ad-b13ff297ff55" status: 200 len: 1451 microversion: 2.1 time: 0.157207 Aug 09 19:04:27.102587 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 561/1154] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:04:26 2022] GET /compute/v2.1/servers/8c44931e-02cc-406a-b6ad-b13ff297ff55 => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:04:27.121527 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-07dd1fb6-40bb-4760-b227-940199dc0980 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:04:27.122169 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-07dd1fb6-40bb-4760-b227-940199dc0980 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 8c44931e-02cc-406a-b6ad-b13ff297ff55] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:04:27.128977 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-07dd1fb6-40bb-4760-b227-940199dc0980 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:04:27.129480 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-07dd1fb6-40bb-4760-b227-940199dc0980 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:04:27.129943 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-07dd1fb6-40bb-4760-b227-940199dc0980 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:04:27.130637 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-07dd1fb6-40bb-4760-b227-940199dc0980 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:04:27.131088 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-07dd1fb6-40bb-4760-b227-940199dc0980 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:04:27.131513 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-07dd1fb6-40bb-4760-b227-940199dc0980 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:04:27.267146 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-07dd1fb6-40bb-4760-b227-940199dc0980 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:04:27.274791 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-07dd1fb6-40bb-4760-b227-940199dc0980 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/8c44931e-02cc-406a-b6ad-b13ff297ff55" status: 200 len: 1451 microversion: 2.1 time: 0.157136 Aug 09 19:04:27.275370 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 594/1155] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:04:27 2022] GET /compute/v2.1/servers/8c44931e-02cc-406a-b6ad-b13ff297ff55 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:04:29.419569 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-669b5f23-ed2b-46b7-9beb-5342355d19a5 req-b0db8d7a-d9d8-40fd-a239-974e97e91a9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c44931e-02cc-406a-b6ad-b13ff297ff55", "tag": "4f7bb470-1f68-40d8-8609-811d1c967a4e"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:04:29.429919 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-669b5f23-ed2b-46b7-9beb-5342355d19a5 req-b0db8d7a-d9d8-40fd-a239-974e97e91a9e service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:04:29.430478 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-669b5f23-ed2b-46b7-9beb-5342355d19a5 req-b0db8d7a-d9d8-40fd-a239-974e97e91a9e service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:04:29.430931 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-669b5f23-ed2b-46b7-9beb-5342355d19a5 req-b0db8d7a-d9d8-40fd-a239-974e97e91a9e service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:04:29.442496 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-669b5f23-ed2b-46b7-9beb-5342355d19a5 req-b0db8d7a-d9d8-40fd-a239-974e97e91a9e service nova] Creating event network-changed:4f7bb470-1f68-40d8-8609-811d1c967a4e for instance 8c44931e-02cc-406a-b6ad-b13ff297ff55 on hv-cinder-82660 Aug 09 19:04:29.447738 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-669b5f23-ed2b-46b7-9beb-5342355d19a5 req-b0db8d7a-d9d8-40fd-a239-974e97e91a9e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031865 Aug 09 19:04:29.448331 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 562/1156] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 19:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:05:23.100308 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 19:05:23.101088 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Tue Aug 9 19:05:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 19:05:32.128176 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 19:05:32.128777 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Tue Aug 9 19:05:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 19:05:57.519012 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:05:57.520001 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=56 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:05:57.521598 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_api:SELECT=24 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:05:57.522920 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG dbcounter [-] [124726] Writing DB stats nova_cell1:SELECT=48 {{(pid=124726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:05:57.524570 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-39b72005-d1e5-47f3-b2f1-7823e4ad0832 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:05:57.525138 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-39b72005-d1e5-47f3-b2f1-7823e4ad0832 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 8c44931e-02cc-406a-b6ad-b13ff297ff55] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:05:57.527217 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-c2505026-32bf-4d35-b34c-84d72b78d223 req-631fd6c8-5629-4cea-9f2c-8b88a106e8f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c44931e-02cc-406a-b6ad-b13ff297ff55", "tag": "4f7bb470-1f68-40d8-8609-811d1c967a4e"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:05:57.531447 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-39b72005-d1e5-47f3-b2f1-7823e4ad0832 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:05:57.532014 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-39b72005-d1e5-47f3-b2f1-7823e4ad0832 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:05:57.532526 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-39b72005-d1e5-47f3-b2f1-7823e4ad0832 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:05:57.533359 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-39b72005-d1e5-47f3-b2f1-7823e4ad0832 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:05:57.533899 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-39b72005-d1e5-47f3-b2f1-7823e4ad0832 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:05:57.534396 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-39b72005-d1e5-47f3-b2f1-7823e4ad0832 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:05:57.537235 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-c2505026-32bf-4d35-b34c-84d72b78d223 req-631fd6c8-5629-4cea-9f2c-8b88a106e8f6 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:05:57.537754 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-c2505026-32bf-4d35-b34c-84d72b78d223 req-631fd6c8-5629-4cea-9f2c-8b88a106e8f6 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:05:57.538185 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-c2505026-32bf-4d35-b34c-84d72b78d223 req-631fd6c8-5629-4cea-9f2c-8b88a106e8f6 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:05:57.549844 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-c2505026-32bf-4d35-b34c-84d72b78d223 req-631fd6c8-5629-4cea-9f2c-8b88a106e8f6 service nova] Creating event network-changed:4f7bb470-1f68-40d8-8609-811d1c967a4e for instance 8c44931e-02cc-406a-b6ad-b13ff297ff55 on hv-cinder-82660 Aug 09 19:05:57.555424 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-c2505026-32bf-4d35-b34c-84d72b78d223 req-631fd6c8-5629-4cea-9f2c-8b88a106e8f6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035921 Aug 09 19:05:57.556226 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 563/1157] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 19:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 19:05:57.562684 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-39b72005-d1e5-47f3-b2f1-7823e4ad0832 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 8c44931e-02cc-406a-b6ad-b13ff297ff55] Going to try to terminate instance {{(pid=124725) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 19:05:57.998077 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-39b72005-d1e5-47f3-b2f1-7823e4ad0832 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8c44931e-02cc-406a-b6ad-b13ff297ff55" status: 204 len: 0 microversion: 2.1 time: 0.480698 Aug 09 19:05:58.002712 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 595/1158] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 9 19:05:57 2022] DELETE /compute/v2.1/servers/8c44931e-02cc-406a-b6ad-b13ff297ff55 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 19:05:58.008354 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-2fdcc488-4d53-439e-b724-706fb688f84e tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:05:58.009063 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-2fdcc488-4d53-439e-b724-706fb688f84e tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 8c44931e-02cc-406a-b6ad-b13ff297ff55] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:05:58.016471 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2fdcc488-4d53-439e-b724-706fb688f84e tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:05:58.021656 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2fdcc488-4d53-439e-b724-706fb688f84e tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:05:58.021656 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2fdcc488-4d53-439e-b724-706fb688f84e tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:05:58.021656 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2fdcc488-4d53-439e-b724-706fb688f84e tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:05:58.021656 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2fdcc488-4d53-439e-b724-706fb688f84e tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:05:58.022055 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-2fdcc488-4d53-439e-b724-706fb688f84e tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:05:58.165639 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-2fdcc488-4d53-439e-b724-706fb688f84e tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:05:58.173189 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-2fdcc488-4d53-439e-b724-706fb688f84e tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/8c44931e-02cc-406a-b6ad-b13ff297ff55" status: 200 len: 1575 microversion: 2.1 time: 0.169120 Aug 09 19:05:58.173785 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 564/1159] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:05:58 2022] GET /compute/v2.1/servers/8c44931e-02cc-406a-b6ad-b13ff297ff55 => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:05:59.195685 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e4b33010-052a-423c-943b-158abf13eacd tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:05:59.196373 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e4b33010-052a-423c-943b-158abf13eacd tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 8c44931e-02cc-406a-b6ad-b13ff297ff55] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:05:59.203044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e4b33010-052a-423c-943b-158abf13eacd tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:05:59.203519 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e4b33010-052a-423c-943b-158abf13eacd tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:05:59.204447 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e4b33010-052a-423c-943b-158abf13eacd tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:05:59.205144 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e4b33010-052a-423c-943b-158abf13eacd tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:05:59.205616 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e4b33010-052a-423c-943b-158abf13eacd tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:05:59.208502 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e4b33010-052a-423c-943b-158abf13eacd tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:05:59.352366 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e4b33010-052a-423c-943b-158abf13eacd tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:05:59.359914 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e4b33010-052a-423c-943b-158abf13eacd tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/8c44931e-02cc-406a-b6ad-b13ff297ff55" status: 200 len: 1457 microversion: 2.1 time: 0.168846 Aug 09 19:05:59.360494 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 596/1160] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:05:59 2022] GET /compute/v2.1/servers/8c44931e-02cc-406a-b6ad-b13ff297ff55 => generated 1457 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:06:00.013069 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-cb89b011-5c8a-4c6e-9d9c-e8d677f4111d req-cd7e3221-938a-42e7-8a30-7118ede93395 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c44931e-02cc-406a-b6ad-b13ff297ff55", "name": "network-vif-deleted", "tag": "4f7bb470-1f68-40d8-8609-811d1c967a4e"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:06:00.022754 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-cb89b011-5c8a-4c6e-9d9c-e8d677f4111d req-cd7e3221-938a-42e7-8a30-7118ede93395 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:06:00.026031 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-cb89b011-5c8a-4c6e-9d9c-e8d677f4111d req-cd7e3221-938a-42e7-8a30-7118ede93395 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:06:00.026031 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-cb89b011-5c8a-4c6e-9d9c-e8d677f4111d req-cd7e3221-938a-42e7-8a30-7118ede93395 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:06:00.035578 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-cb89b011-5c8a-4c6e-9d9c-e8d677f4111d req-cd7e3221-938a-42e7-8a30-7118ede93395 service nova] Creating event network-vif-deleted:4f7bb470-1f68-40d8-8609-811d1c967a4e for instance 8c44931e-02cc-406a-b6ad-b13ff297ff55 on hv-cinder-82660 Aug 09 19:06:00.040556 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-cb89b011-5c8a-4c6e-9d9c-e8d677f4111d req-cd7e3221-938a-42e7-8a30-7118ede93395 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031404 Aug 09 19:06:00.041137 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 565/1161] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 19:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:06:00.380543 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-007d4bf0-b320-4d17-a9b2-e0f72ad6553c tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:06:00.381166 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-007d4bf0-b320-4d17-a9b2-e0f72ad6553c tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 8c44931e-02cc-406a-b6ad-b13ff297ff55] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:06:00.387714 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-007d4bf0-b320-4d17-a9b2-e0f72ad6553c tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:06:00.388210 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-007d4bf0-b320-4d17-a9b2-e0f72ad6553c tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:06:00.388651 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-007d4bf0-b320-4d17-a9b2-e0f72ad6553c tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:06:00.389569 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-007d4bf0-b320-4d17-a9b2-e0f72ad6553c tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:06:00.389959 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-007d4bf0-b320-4d17-a9b2-e0f72ad6553c tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:06:00.390390 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-007d4bf0-b320-4d17-a9b2-e0f72ad6553c tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:06:00.457923 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-007d4bf0-b320-4d17-a9b2-e0f72ad6553c tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:06:00.465883 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-007d4bf0-b320-4d17-a9b2-e0f72ad6553c tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/8c44931e-02cc-406a-b6ad-b13ff297ff55" status: 200 len: 1224 microversion: 2.1 time: 0.089147 Aug 09 19:06:00.466469 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 597/1162] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:06:00 2022] GET /compute/v2.1/servers/8c44931e-02cc-406a-b6ad-b13ff297ff55 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:06:01.488712 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-babc5de1-c96e-489b-8b13-6cacd0b1892a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:06:01.489408 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-babc5de1-c96e-489b-8b13-6cacd0b1892a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 8c44931e-02cc-406a-b6ad-b13ff297ff55] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:06:01.495633 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-babc5de1-c96e-489b-8b13-6cacd0b1892a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:06:01.496116 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-babc5de1-c96e-489b-8b13-6cacd0b1892a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:06:01.496808 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-babc5de1-c96e-489b-8b13-6cacd0b1892a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:06:01.497510 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-babc5de1-c96e-489b-8b13-6cacd0b1892a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:06:01.497989 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-babc5de1-c96e-489b-8b13-6cacd0b1892a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:06:01.498430 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-babc5de1-c96e-489b-8b13-6cacd0b1892a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:06:01.513254 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.wsgi [None req-babc5de1-c96e-489b-8b13-6cacd0b1892a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] HTTP exception thrown: Instance 8c44931e-02cc-406a-b6ad-b13ff297ff55 could not be found. Aug 09 19:06:01.515068 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-babc5de1-c96e-489b-8b13-6cacd0b1892a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Request method failure captured: Aug 09 19:06:01.515068 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: request: GET /compute/v2.1/servers/8c44931e-02cc-406a-b6ad-b13ff297ff55 HTTP/1.1 Aug 09 19:06:01.515068 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept: application/json Aug 09 19:06:01.515068 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept-Encoding: identity Aug 09 19:06:01.515068 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Connection: close Aug 09 19:06:01.515068 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Length: 0 Aug 09 19:06:01.515068 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Type: application/json Aug 09 19:06:01.515068 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Host: 10.222.0.57 Aug 09 19:06:01.515068 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Openstack-System-Scope: None Aug 09 19:06:01.515068 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: User-Agent: python-urllib3/1.26.11 Aug 09 19:06:01.515068 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Auth-Token: gAAAAABi8q6GJR2EhH1Kr2xEKpP0-jVqEMC8I7Ee7gctxgNP-ikGjM2fAZohTB_9B3m3ZUpyPCJOzp2JgMc2cz1cMu4G3LOZLO6V-GEar4TwrNte3T79zpeBdEyKPpRd39t6HpDhn2XbYgxEwuN_tMWkPRUXYBHedYpSe0cf_X4srkv2OVDds8w Aug 09 19:06:01.515068 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Id: None Aug 09 19:06:01.515068 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Name: None Aug 09 19:06:01.515068 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Identity-Status: Confirmed Aug 09 19:06:01.515068 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Is-Admin-Project: True Aug 09 19:06:01.515068 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Id: default Aug 09 19:06:01.515068 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Name: Default Aug 09 19:06:01.515068 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Id: 098c57b11d7948c8a1ef732af98ec75f Aug 09 19:06:01.515068 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Name: tempest-TestVolumeBootPattern-1500127689 Aug 09 19:06:01.515068 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Role: reader,member Aug 09 19:06:01.515068 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Roles: reader,member Aug 09 19:06:01.517028 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_098c57b11d7948c8a1ef732af98ec75f", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/098c57b11d7948c8a1ef732af98ec75f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/098c57b11d7948c8a1ef732af98ec75f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/098c57b11d7948c8a1ef732af98ec75f"}]}] Aug 09 19:06:01.517028 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant: tempest-TestVolumeBootPattern-1500127689 Aug 09 19:06:01.517028 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Id: 098c57b11d7948c8a1ef732af98ec75f Aug 09 19:06:01.517028 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Name: tempest-TestVolumeBootPattern-1500127689 Aug 09 19:06:01.517028 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User: tempest-TestVolumeBootPattern-1500127689-project Aug 09 19:06:01.517028 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Id: default Aug 09 19:06:01.517028 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Name: Default Aug 09 19:06:01.517028 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Id: dbed10f27ab548809755b32d0456d1bc Aug 09 19:06:01.517028 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Name: tempest-TestVolumeBootPattern-1500127689-project Aug 09 19:06:01.517028 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: method: > Aug 09 19:06:01.517028 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: exception: Instance 8c44931e-02cc-406a-b6ad-b13ff297ff55 could not be found. Aug 09 19:06:01.517028 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: action_args: {'id': '8c44931e-02cc-406a-b6ad-b13ff297ff55'} Aug 09 19:06:01.518277 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:06:01.518277 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:06:01.518277 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:06:01.518277 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:06:01.518277 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:06:01.518277 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:06:01.518277 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:06:01.518277 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:06:01.518277 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:06:01.518277 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:06:01.518277 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c44931e-02cc-406a-b6ad-b13ff297ff55 could not be found. Aug 09 19:06:01.518277 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 19:06:01.518277 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:06:01.518277 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 19:06:01.518277 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:06:01.518277 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:06:01.518277 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:06:01.518277 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:06:01.518277 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:06:01.518277 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:06:01.520089 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:06:01.520089 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 19:06:01.520089 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 19:06:01.520089 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:06:01.520089 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:06:01.520089 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:06:01.520089 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:06:01.520089 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c44931e-02cc-406a-b6ad-b13ff297ff55 could not be found. Aug 09 19:06:01.520089 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 19:06:01.520089 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:06:01.520089 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 19:06:01.520089 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:06:01.520089 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:06:01.520089 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:06:01.520089 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:06:01.520089 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:06:01.520089 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c44931e-02cc-406a-b6ad-b13ff297ff55 could not be found. Aug 09 19:06:01.520089 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 19:06:01.521726 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-babc5de1-c96e-489b-8b13-6cacd0b1892a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Returning 404 to user: Instance 8c44931e-02cc-406a-b6ad-b13ff297ff55 could not be found. {{(pid=124726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:06:01.521726 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-babc5de1-c96e-489b-8b13-6cacd0b1892a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/8c44931e-02cc-406a-b6ad-b13ff297ff55" status: 404 len: 111 microversion: 2.1 time: 0.033029 Aug 09 19:06:01.521726 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 566/1163] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:06:01 2022] GET /compute/v2.1/servers/8c44931e-02cc-406a-b6ad-b13ff297ff55 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:06:04.908470 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-0981a402-7aa8-4304-ac28-71ea87a8bdbc tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:06:04.909512 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-0981a402-7aa8-4304-ac28-71ea87a8bdbc tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 4e0810d4-4897-458d-bf93-4826c5770a5f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:06:04.915358 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-0e8950e0-2be0-4526-ad58-28e0be852c00 req-a7a538fb-91c8-4f87-9eb7-e487d883316c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e0810d4-4897-458d-bf93-4826c5770a5f", "tag": "c694a3a7-c51a-45fd-b548-13ae2dede97e"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:06:04.917253 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0981a402-7aa8-4304-ac28-71ea87a8bdbc tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:06:04.917852 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0981a402-7aa8-4304-ac28-71ea87a8bdbc tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:06:04.918483 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0981a402-7aa8-4304-ac28-71ea87a8bdbc tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:06:04.919177 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0981a402-7aa8-4304-ac28-71ea87a8bdbc tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:06:04.919815 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0981a402-7aa8-4304-ac28-71ea87a8bdbc tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:06:04.920233 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0981a402-7aa8-4304-ac28-71ea87a8bdbc tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:06:04.929108 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-0e8950e0-2be0-4526-ad58-28e0be852c00 req-a7a538fb-91c8-4f87-9eb7-e487d883316c service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:06:04.929765 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-0e8950e0-2be0-4526-ad58-28e0be852c00 req-a7a538fb-91c8-4f87-9eb7-e487d883316c service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:06:04.930312 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-0e8950e0-2be0-4526-ad58-28e0be852c00 req-a7a538fb-91c8-4f87-9eb7-e487d883316c service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:06:04.943448 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-0e8950e0-2be0-4526-ad58-28e0be852c00 req-a7a538fb-91c8-4f87-9eb7-e487d883316c service nova] Creating event network-changed:c694a3a7-c51a-45fd-b548-13ae2dede97e for instance 4e0810d4-4897-458d-bf93-4826c5770a5f on hv-cinder-82660 Aug 09 19:06:04.949195 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-0e8950e0-2be0-4526-ad58-28e0be852c00 req-a7a538fb-91c8-4f87-9eb7-e487d883316c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038201 Aug 09 19:06:04.949702 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-0981a402-7aa8-4304-ac28-71ea87a8bdbc tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 4e0810d4-4897-458d-bf93-4826c5770a5f] Going to try to terminate instance {{(pid=124725) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 19:06:04.950346 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 567/1164] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 19:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:06:05.193694 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-0981a402-7aa8-4304-ac28-71ea87a8bdbc tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f" status: 204 len: 0 microversion: 2.1 time: 0.290048 Aug 09 19:06:05.194458 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 598/1165] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 9 19:06:04 2022] DELETE /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 19:06:05.204572 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-155a8019-e1fc-4a9b-881b-71b25260e93b tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:06:05.205339 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-155a8019-e1fc-4a9b-881b-71b25260e93b tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 4e0810d4-4897-458d-bf93-4826c5770a5f] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:06:05.211867 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-155a8019-e1fc-4a9b-881b-71b25260e93b tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:06:05.212357 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-155a8019-e1fc-4a9b-881b-71b25260e93b tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:06:05.212814 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-155a8019-e1fc-4a9b-881b-71b25260e93b tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:06:05.213593 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-155a8019-e1fc-4a9b-881b-71b25260e93b tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:06:05.214256 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-155a8019-e1fc-4a9b-881b-71b25260e93b tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:06:05.214994 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-155a8019-e1fc-4a9b-881b-71b25260e93b tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:06:05.362279 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.policy [None req-155a8019-e1fc-4a9b-881b-71b25260e93b tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124726) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:06:05.370257 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-155a8019-e1fc-4a9b-881b-71b25260e93b tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f" status: 200 len: 1576 microversion: 2.1 time: 0.170768 Aug 09 19:06:05.370840 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 568/1166] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:06:05 2022] GET /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:06:06.392313 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-41615c89-0cec-4df3-b71a-2b43a85c25fa tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:06:06.393003 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-41615c89-0cec-4df3-b71a-2b43a85c25fa tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 4e0810d4-4897-458d-bf93-4826c5770a5f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:06:06.399736 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-41615c89-0cec-4df3-b71a-2b43a85c25fa tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:06:06.400219 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-41615c89-0cec-4df3-b71a-2b43a85c25fa tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:06:06.406194 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-41615c89-0cec-4df3-b71a-2b43a85c25fa tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:06:06.406194 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-41615c89-0cec-4df3-b71a-2b43a85c25fa tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:06:06.406194 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-41615c89-0cec-4df3-b71a-2b43a85c25fa tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:06:06.406194 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-41615c89-0cec-4df3-b71a-2b43a85c25fa tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:06:06.564010 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-41615c89-0cec-4df3-b71a-2b43a85c25fa tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:06:06.572460 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-41615c89-0cec-4df3-b71a-2b43a85c25fa tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f" status: 200 len: 1576 microversion: 2.1 time: 0.184389 Aug 09 19:06:06.573046 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 599/1167] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:06:06 2022] GET /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f => generated 1576 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:06:07.192801 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [req-14f9aabf-08d3-48bc-ab71-739a2ad915a9 req-a76ff912-3d93-4bcc-a310-4b9edd7d34f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e0810d4-4897-458d-bf93-4826c5770a5f", "name": "network-vif-deleted", "tag": "c694a3a7-c51a-45fd-b548-13ae2dede97e"}]} {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:06:07.202400 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-14f9aabf-08d3-48bc-ab71-739a2ad915a9 req-a76ff912-3d93-4bcc-a310-4b9edd7d34f8 service nova] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:06:07.202873 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-14f9aabf-08d3-48bc-ab71-739a2ad915a9 req-a76ff912-3d93-4bcc-a310-4b9edd7d34f8 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:06:07.203294 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [req-14f9aabf-08d3-48bc-ab71-739a2ad915a9 req-a76ff912-3d93-4bcc-a310-4b9edd7d34f8 service nova] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:06:07.216114 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.compute.server_external_events [req-14f9aabf-08d3-48bc-ab71-739a2ad915a9 req-a76ff912-3d93-4bcc-a310-4b9edd7d34f8 service nova] Creating event network-vif-deleted:c694a3a7-c51a-45fd-b548-13ae2dede97e for instance 4e0810d4-4897-458d-bf93-4826c5770a5f on hv-cinder-82660 Aug 09 19:06:07.220931 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [req-14f9aabf-08d3-48bc-ab71-739a2ad915a9 req-a76ff912-3d93-4bcc-a310-4b9edd7d34f8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032525 Aug 09 19:06:07.221500 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 569/1168] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 9 19:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:06:07.596150 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-dfe81a1b-5c6d-47bf-b509-ab9ffbf6be2a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:06:07.596669 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-dfe81a1b-5c6d-47bf-b509-ab9ffbf6be2a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 4e0810d4-4897-458d-bf93-4826c5770a5f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:06:07.603725 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dfe81a1b-5c6d-47bf-b509-ab9ffbf6be2a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:06:07.604211 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dfe81a1b-5c6d-47bf-b509-ab9ffbf6be2a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:06:07.604653 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dfe81a1b-5c6d-47bf-b509-ab9ffbf6be2a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:06:07.605986 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dfe81a1b-5c6d-47bf-b509-ab9ffbf6be2a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:06:07.606448 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dfe81a1b-5c6d-47bf-b509-ab9ffbf6be2a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:06:07.607211 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dfe81a1b-5c6d-47bf-b509-ab9ffbf6be2a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:06:07.673749 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-dfe81a1b-5c6d-47bf-b509-ab9ffbf6be2a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed10f27ab548809755b32d0456d1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098c57b11d7948c8a1ef732af98ec75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:06:07.681305 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-dfe81a1b-5c6d-47bf-b509-ab9ffbf6be2a tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f" status: 200 len: 1225 microversion: 2.1 time: 0.089765 Aug 09 19:06:07.681904 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 600/1169] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:06:07 2022] GET /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:06:08.703759 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-27562c27-bacf-4c87-8c4f-bad8fe7adb94 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:06:08.705001 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-27562c27-bacf-4c87-8c4f-bad8fe7adb94 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 4e0810d4-4897-458d-bf93-4826c5770a5f] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:06:08.711185 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-27562c27-bacf-4c87-8c4f-bad8fe7adb94 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:06:08.711665 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-27562c27-bacf-4c87-8c4f-bad8fe7adb94 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:06:08.712150 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-27562c27-bacf-4c87-8c4f-bad8fe7adb94 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:06:08.712843 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-27562c27-bacf-4c87-8c4f-bad8fe7adb94 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:06:08.713297 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-27562c27-bacf-4c87-8c4f-bad8fe7adb94 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:06:08.713929 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-27562c27-bacf-4c87-8c4f-bad8fe7adb94 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:06:08.726781 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.wsgi [None req-27562c27-bacf-4c87-8c4f-bad8fe7adb94 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] HTTP exception thrown: Instance 4e0810d4-4897-458d-bf93-4826c5770a5f could not be found. Aug 09 19:06:08.728403 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-27562c27-bacf-4c87-8c4f-bad8fe7adb94 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Request method failure captured: Aug 09 19:06:08.728403 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: request: GET /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f HTTP/1.1 Aug 09 19:06:08.728403 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept: application/json Aug 09 19:06:08.728403 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept-Encoding: identity Aug 09 19:06:08.728403 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Connection: close Aug 09 19:06:08.728403 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Length: 0 Aug 09 19:06:08.728403 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Type: application/json Aug 09 19:06:08.728403 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Host: 10.222.0.57 Aug 09 19:06:08.728403 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Openstack-System-Scope: None Aug 09 19:06:08.728403 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: User-Agent: python-urllib3/1.26.11 Aug 09 19:06:08.728403 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Auth-Token: gAAAAABi8q6GJR2EhH1Kr2xEKpP0-jVqEMC8I7Ee7gctxgNP-ikGjM2fAZohTB_9B3m3ZUpyPCJOzp2JgMc2cz1cMu4G3LOZLO6V-GEar4TwrNte3T79zpeBdEyKPpRd39t6HpDhn2XbYgxEwuN_tMWkPRUXYBHedYpSe0cf_X4srkv2OVDds8w Aug 09 19:06:08.728403 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Id: None Aug 09 19:06:08.728403 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Name: None Aug 09 19:06:08.728403 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Identity-Status: Confirmed Aug 09 19:06:08.728403 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Is-Admin-Project: True Aug 09 19:06:08.728403 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Id: default Aug 09 19:06:08.728403 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Name: Default Aug 09 19:06:08.728403 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Id: 098c57b11d7948c8a1ef732af98ec75f Aug 09 19:06:08.728403 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Name: tempest-TestVolumeBootPattern-1500127689 Aug 09 19:06:08.728403 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Role: reader,member Aug 09 19:06:08.728403 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Roles: reader,member Aug 09 19:06:08.730304 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_098c57b11d7948c8a1ef732af98ec75f", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/098c57b11d7948c8a1ef732af98ec75f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/098c57b11d7948c8a1ef732af98ec75f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/098c57b11d7948c8a1ef732af98ec75f"}]}] Aug 09 19:06:08.730304 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant: tempest-TestVolumeBootPattern-1500127689 Aug 09 19:06:08.730304 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Id: 098c57b11d7948c8a1ef732af98ec75f Aug 09 19:06:08.730304 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Name: tempest-TestVolumeBootPattern-1500127689 Aug 09 19:06:08.730304 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User: tempest-TestVolumeBootPattern-1500127689-project Aug 09 19:06:08.730304 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Id: default Aug 09 19:06:08.730304 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Name: Default Aug 09 19:06:08.730304 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Id: dbed10f27ab548809755b32d0456d1bc Aug 09 19:06:08.730304 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Name: tempest-TestVolumeBootPattern-1500127689-project Aug 09 19:06:08.730304 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: method: > Aug 09 19:06:08.730304 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: exception: Instance 4e0810d4-4897-458d-bf93-4826c5770a5f could not be found. Aug 09 19:06:08.730304 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: action_args: {'id': '4e0810d4-4897-458d-bf93-4826c5770a5f'} Aug 09 19:06:08.731455 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:06:08.731455 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:06:08.731455 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:06:08.731455 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:06:08.731455 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:06:08.731455 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:06:08.731455 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:06:08.731455 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:06:08.731455 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:06:08.731455 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:06:08.731455 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e0810d4-4897-458d-bf93-4826c5770a5f could not be found. Aug 09 19:06:08.731455 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 19:06:08.731455 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:06:08.731455 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 19:06:08.731455 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:06:08.731455 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:06:08.731455 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:06:08.731455 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:06:08.731455 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:06:08.731455 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:06:08.733158 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:06:08.733158 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 19:06:08.733158 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 19:06:08.733158 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:06:08.733158 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:06:08.733158 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:06:08.733158 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:06:08.733158 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e0810d4-4897-458d-bf93-4826c5770a5f could not be found. Aug 09 19:06:08.733158 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 19:06:08.733158 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:06:08.733158 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 19:06:08.733158 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:06:08.733158 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:06:08.733158 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:06:08.733158 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:06:08.733158 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:06:08.733158 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e0810d4-4897-458d-bf93-4826c5770a5f could not be found. Aug 09 19:06:08.733158 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 19:06:08.734826 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-27562c27-bacf-4c87-8c4f-bad8fe7adb94 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Returning 404 to user: Instance 4e0810d4-4897-458d-bf93-4826c5770a5f could not be found. {{(pid=124726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:06:08.734826 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-27562c27-bacf-4c87-8c4f-bad8fe7adb94 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f" status: 404 len: 111 microversion: 2.1 time: 0.031351 Aug 09 19:06:08.734826 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 570/1170] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:06:08 2022] GET /compute/v2.1/servers/4e0810d4-4897-458d-bf93-4826c5770a5f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:06:09.292313 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-861665aa-062b-41ff-91e2-3dfc78c2bf33 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:06:09.292855 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-861665aa-062b-41ff-91e2-3dfc78c2bf33 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 09500412-38e3-4e69-ac88-88ff4cbdb710] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:06:09.299813 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-861665aa-062b-41ff-91e2-3dfc78c2bf33 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:06:09.300291 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-861665aa-062b-41ff-91e2-3dfc78c2bf33 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:06:09.300727 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-861665aa-062b-41ff-91e2-3dfc78c2bf33 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:06:09.301418 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-861665aa-062b-41ff-91e2-3dfc78c2bf33 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:06:09.301929 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-861665aa-062b-41ff-91e2-3dfc78c2bf33 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:06:09.302362 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-861665aa-062b-41ff-91e2-3dfc78c2bf33 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:06:09.315407 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-861665aa-062b-41ff-91e2-3dfc78c2bf33 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] HTTP exception thrown: Instance 09500412-38e3-4e69-ac88-88ff4cbdb710 could not be found. Aug 09 19:06:09.317044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-861665aa-062b-41ff-91e2-3dfc78c2bf33 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Request method failure captured: Aug 09 19:06:09.317044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: request: DELETE /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710 HTTP/1.1 Aug 09 19:06:09.317044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept: application/json Aug 09 19:06:09.317044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Aug 09 19:06:09.317044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Connection: close Aug 09 19:06:09.317044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Length: 0 Aug 09 19:06:09.317044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Content-Type: application/json Aug 09 19:06:09.317044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Host: 10.222.0.57 Aug 09 19:06:09.317044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Aug 09 19:06:09.317044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.11 Aug 09 19:06:09.317044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABi8q6GJR2EhH1Kr2xEKpP0-jVqEMC8I7Ee7gctxgNP-ikGjM2fAZohTB_9B3m3ZUpyPCJOzp2JgMc2cz1cMu4G3LOZLO6V-GEar4TwrNte3T79zpeBdEyKPpRd39t6HpDhn2XbYgxEwuN_tMWkPRUXYBHedYpSe0cf_X4srkv2OVDds8w Aug 09 19:06:09.317044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Aug 09 19:06:09.317044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Aug 09 19:06:09.317044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Aug 09 19:06:09.317044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Aug 09 19:06:09.317044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Aug 09 19:06:09.317044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Aug 09 19:06:09.317044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Id: 098c57b11d7948c8a1ef732af98ec75f Aug 09 19:06:09.317044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-TestVolumeBootPattern-1500127689 Aug 09 19:06:09.317044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Role: reader,member Aug 09 19:06:09.317044 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Roles: reader,member Aug 09 19:06:09.318578 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_098c57b11d7948c8a1ef732af98ec75f", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/098c57b11d7948c8a1ef732af98ec75f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/098c57b11d7948c8a1ef732af98ec75f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/098c57b11d7948c8a1ef732af98ec75f"}]}] Aug 09 19:06:09.318578 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-TestVolumeBootPattern-1500127689 Aug 09 19:06:09.318578 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 098c57b11d7948c8a1ef732af98ec75f Aug 09 19:06:09.318578 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-TestVolumeBootPattern-1500127689 Aug 09 19:06:09.318578 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User: tempest-TestVolumeBootPattern-1500127689-project Aug 09 19:06:09.318578 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Aug 09 19:06:09.318578 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Aug 09 19:06:09.318578 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Id: dbed10f27ab548809755b32d0456d1bc Aug 09 19:06:09.318578 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-TestVolumeBootPattern-1500127689-project Aug 09 19:06:09.318578 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: method: > Aug 09 19:06:09.318578 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: exception: Instance 09500412-38e3-4e69-ac88-88ff4cbdb710 could not be found. Aug 09 19:06:09.318578 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: action_args: {'id': '09500412-38e3-4e69-ac88-88ff4cbdb710'} Aug 09 19:06:09.319823 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:06:09.319823 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:06:09.319823 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:06:09.319823 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:06:09.319823 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:06:09.319823 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:06:09.319823 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:06:09.319823 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:06:09.319823 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:06:09.319823 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:06:09.319823 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09500412-38e3-4e69-ac88-88ff4cbdb710 could not be found. Aug 09 19:06:09.319823 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 19:06:09.319823 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:06:09.319823 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 19:06:09.319823 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:06:09.319823 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:06:09.319823 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:06:09.319823 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:06:09.319823 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:06:09.319823 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:06:09.321706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:06:09.321706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 19:06:09.321706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 19:06:09.321706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 19:06:09.321706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 19:06:09.321706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:06:09.321706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:06:09.321706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:06:09.321706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:06:09.321706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09500412-38e3-4e69-ac88-88ff4cbdb710 could not be found. Aug 09 19:06:09.321706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 19:06:09.321706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:06:09.321706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 19:06:09.321706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:06:09.321706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:06:09.321706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:06:09.321706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:06:09.321706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:06:09.321706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09500412-38e3-4e69-ac88-88ff4cbdb710 could not be found. Aug 09 19:06:09.321706 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Aug 09 19:06:09.323715 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-861665aa-062b-41ff-91e2-3dfc78c2bf33 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Returning 404 to user: Instance 09500412-38e3-4e69-ac88-88ff4cbdb710 could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:06:09.323715 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-861665aa-062b-41ff-91e2-3dfc78c2bf33 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "DELETE /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710" status: 404 len: 111 microversion: 2.1 time: 0.030723 Aug 09 19:06:09.323715 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 601/1171] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 9 19:06:09 2022] DELETE /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:06:09.327232 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-a642db2c-69b9-4354-ac85-d4e0a6de5be0 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '>' {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:06:09.327857 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.compute.api [None req-a642db2c-69b9-4354-ac85-d4e0a6de5be0 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] [instance: 09500412-38e3-4e69-ac88-88ff4cbdb710] Fetching instance by UUID {{(pid=124726) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:06:09.334005 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a642db2c-69b9-4354-ac85-d4e0a6de5be0 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:06:09.334488 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a642db2c-69b9-4354-ac85-d4e0a6de5be0 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:06:09.334945 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a642db2c-69b9-4354-ac85-d4e0a6de5be0 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:06:09.335664 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a642db2c-69b9-4354-ac85-d4e0a6de5be0 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Acquiring lock "9980bb26-9539-4867-bcdf-a8100feea5e1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:06:09.336113 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a642db2c-69b9-4354-ac85-d4e0a6de5be0 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:06:09.336534 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG oslo_concurrency.lockutils [None req-a642db2c-69b9-4354-ac85-d4e0a6de5be0 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Lock "9980bb26-9539-4867-bcdf-a8100feea5e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:06:09.350534 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.wsgi [None req-a642db2c-69b9-4354-ac85-d4e0a6de5be0 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] HTTP exception thrown: Instance 09500412-38e3-4e69-ac88-88ff4cbdb710 could not be found. Aug 09 19:06:09.352044 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-a642db2c-69b9-4354-ac85-d4e0a6de5be0 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Request method failure captured: Aug 09 19:06:09.352044 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: request: GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710 HTTP/1.1 Aug 09 19:06:09.352044 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept: application/json Aug 09 19:06:09.352044 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Accept-Encoding: identity Aug 09 19:06:09.352044 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Connection: close Aug 09 19:06:09.352044 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Length: 0 Aug 09 19:06:09.352044 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Content-Type: application/json Aug 09 19:06:09.352044 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Host: 10.222.0.57 Aug 09 19:06:09.352044 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Openstack-System-Scope: None Aug 09 19:06:09.352044 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: User-Agent: python-urllib3/1.26.11 Aug 09 19:06:09.352044 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Auth-Token: gAAAAABi8q6GJR2EhH1Kr2xEKpP0-jVqEMC8I7Ee7gctxgNP-ikGjM2fAZohTB_9B3m3ZUpyPCJOzp2JgMc2cz1cMu4G3LOZLO6V-GEar4TwrNte3T79zpeBdEyKPpRd39t6HpDhn2XbYgxEwuN_tMWkPRUXYBHedYpSe0cf_X4srkv2OVDds8w Aug 09 19:06:09.352044 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Id: None Aug 09 19:06:09.352044 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Domain-Name: None Aug 09 19:06:09.352044 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Identity-Status: Confirmed Aug 09 19:06:09.352044 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Is-Admin-Project: True Aug 09 19:06:09.352044 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Id: default Aug 09 19:06:09.352044 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Domain-Name: Default Aug 09 19:06:09.352044 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Id: 098c57b11d7948c8a1ef732af98ec75f Aug 09 19:06:09.352044 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Project-Name: tempest-TestVolumeBootPattern-1500127689 Aug 09 19:06:09.352044 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Role: reader,member Aug 09 19:06:09.352044 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Roles: reader,member Aug 09 19:06:09.353821 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_098c57b11d7948c8a1ef732af98ec75f", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/098c57b11d7948c8a1ef732af98ec75f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/098c57b11d7948c8a1ef732af98ec75f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/098c57b11d7948c8a1ef732af98ec75f"}]}] Aug 09 19:06:09.353821 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant: tempest-TestVolumeBootPattern-1500127689 Aug 09 19:06:09.353821 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Id: 098c57b11d7948c8a1ef732af98ec75f Aug 09 19:06:09.353821 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-Tenant-Name: tempest-TestVolumeBootPattern-1500127689 Aug 09 19:06:09.353821 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User: tempest-TestVolumeBootPattern-1500127689-project Aug 09 19:06:09.353821 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Id: default Aug 09 19:06:09.353821 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Domain-Name: Default Aug 09 19:06:09.353821 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Id: dbed10f27ab548809755b32d0456d1bc Aug 09 19:06:09.353821 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: X-User-Name: tempest-TestVolumeBootPattern-1500127689-project Aug 09 19:06:09.353821 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: method: > Aug 09 19:06:09.353821 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: exception: Instance 09500412-38e3-4e69-ac88-88ff4cbdb710 could not be found. Aug 09 19:06:09.353821 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: action_args: {'id': '09500412-38e3-4e69-ac88-88ff4cbdb710'} Aug 09 19:06:09.354750 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: {{(pid=124726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:06:09.354750 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:06:09.354750 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:06:09.354750 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:06:09.354750 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:06:09.354750 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:06:09.354750 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:06:09.354750 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:06:09.354750 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:06:09.354750 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:06:09.354750 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09500412-38e3-4e69-ac88-88ff4cbdb710 could not be found. Aug 09 19:06:09.354750 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 19:06:09.354750 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:06:09.354750 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 19:06:09.354750 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:06:09.354750 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:06:09.354750 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:06:09.354750 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:06:09.354750 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:06:09.354750 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:06:09.356188 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:06:09.356188 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 19:06:09.356188 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 19:06:09.356188 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:06:09.356188 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:06:09.356188 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:06:09.356188 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:06:09.356188 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09500412-38e3-4e69-ac88-88ff4cbdb710 could not be found. Aug 09 19:06:09.356188 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 19:06:09.356188 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:06:09.356188 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 19:06:09.356188 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:06:09.356188 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:06:09.356188 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:06:09.356188 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:06:09.356188 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:06:09.356188 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09500412-38e3-4e69-ac88-88ff4cbdb710 could not be found. Aug 09 19:06:09.356188 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: ERROR nova.api.openstack.wsgi Aug 09 19:06:09.357548 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: DEBUG nova.api.openstack.wsgi [None req-a642db2c-69b9-4354-ac85-d4e0a6de5be0 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Returning 404 to user: Instance 09500412-38e3-4e69-ac88-88ff4cbdb710 could not be found. {{(pid=124726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:06:09.357548 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO nova.api.openstack.requestlog [None req-a642db2c-69b9-4354-ac85-d4e0a6de5be0 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710" status: 404 len: 111 microversion: 2.1 time: 0.029974 Aug 09 19:06:09.357548 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: [pid: 124726|app: 0|req: 571/1172] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 9 19:06:09 2022] GET /compute/v2.1/servers/09500412-38e3-4e69-ac88-88ff4cbdb710 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:06:10.916697 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-9afa7d2b-7c86-4a33-a112-0c8b8c18f3e0 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] Calling method '.version_select at 0x7f8d69769c10>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:06:11.021394 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-9afa7d2b-7c86-4a33-a112-0c8b8c18f3e0 tempest-TestVolumeBootPattern-1500127689 tempest-TestVolumeBootPattern-1500127689-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-155422797" status: 202 len: 0 microversion: 2.1 time: 0.108563 Aug 09 19:06:11.022008 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 602/1173] 10.222.0.57 () {58 vars in 1260 bytes} [Tue Aug 9 19:06:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-155422797 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 19:07:18.509933 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 19:07:18.510573 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Tue Aug 9 19:07:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 19:07:23.950496 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 19:07:23.951107 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Tue Aug 9 19:07:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 19:08:43.109591 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 19:08:43.110453 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Tue Aug 9 19:08:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 19:08:52.136450 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 19:08:52.137070 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Tue Aug 9 19:08:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 19:09:12.386327 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 19:09:12.386327 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Tue Aug 9 19:09:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 19:09:23.846601 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 19:09:23.847157 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Tue Aug 9 19:09:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 19:10:38.518791 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 19:10:38.519551 dv-cinder-826608-9-iscsi devstack@n-api.service[124726]: Tue Aug 9 19:10:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 19:10:43.959071 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 19:10:43.960019 dv-cinder-826608-9-iscsi devstack@n-api.service[124725]: Tue Aug 9 19:10:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!